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ABSTRACT * - 

' •* This guidebook is designed to assist Comprehensive 

Entployment * and Training Act prime sponsors in obtaining th6 maximum 
^ benefit for their participants and themselves from follow-up and 
t <£ollow-thrbtugh activities. \An introduction explains the purposes of 
jfche 1 gulfrebooli and overvi<jpWs follow-up and follow-through. ^After an 
/ oVerviewJtof the essential tasks for follow-up, action planning 

guidelines are given for each oi^the seven tasks specif ied* •( V) . ' - 
identify purposes of follow-up activities, (2) design follbw-up 
strategy to cor respond* wrth ,putposes identified, (3) decide, on^^ 
' procedures 1 to carry out the strategy, (4) develop aids for cjata 
collection, (5) collect data, (6) analyze data, and (7) communicate 
information for use according to identified purposes. The*next 
section gives an, overview and the- related, guidelines for the four 
_ Essential tasks for follow-through: identify areas for follow-through 

activities, identify available means 9 ot . [-participant reinforcement, 
& determine effective prbcedures fot delivery of -f olJLow-tbrough 
i^servjces, and implement procedures. . Reference materials contained in 
,~ appendixes include sample follow-up questionnaire, strategies to 
increase confidence in data collected b?;mailed questionnaires, and 
*iftformation on principles *of interviewing, descriptive statistics, 
graphic presentations, - ^ ollbw-th^ough staff, Work maturity skills, 
and implementation' techniques. (YLB) ' y\ 
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FOREWORD 



Follow-Up and FollowThroug[i in Employment and Training Programs: An Action Planning 
Guidebook is one of sixteen products and services developed for the Department of Labor's Office 
of Youth Programs. These products and services^are intended to comprise a "full-service" technical 
assistance model that can beojsfed by the employment and training community to better meet the 
training needs of staff and CETA-elfgib1e youth and adults. 

ThecontFibutions of the Fort Wayne (Indiana) Area Consortium, Philadelphia Office of 
Employment and Training, and Kentucky Balance of State Prime Sponsor are gratefully acknowl- 
edged, fhese sites participated fn the planning ahtf jSilot testing of selected products and services. 

Appreciation also is expressed to project staff. Sandra Pritz, Program Associate, was, the major 
author. Other^taff members include Brian Fitch, Program Director; Robert'Bhaerman, Research 
Specialist; Bettina Lankard, Program Associate; Gale Zahniser, Program Associate; and William 
Goldwair ; Research Specialist. ' • 



Robert E. Taylor 
Executive Director . 
The National Center for Research 
in Vocational Education . 
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EXECUTIVE SUMMARY 

* X . * 

, — WhilS collection of follow-up data is fnandated*for reporting purposes, creative use of the * 
follow-up procedure can yield a number of other benefits. The most obvious is the feedback that 
can be used to improve program offerings, curricular content, and the overall preparation of 
participants for a job. Another advantage the follcJw-up system can provide is the opportunity to 
deepen contacts with employers in the community and to gain additional information about the 
labor market and the hiring, training, and promotional practices of businesses. 

* • ' 

It is important -that follow-through with the participant be closely related to the foll©w-up 
effort, "^e long-term effect of the prime sponsor's previous services to the participant may dfepend 
on.helping the participant (and perhaps the employer) to address any problems that surface in 
follow-up. Counseling and referral, to needed support service^ or sources of additional training can 
be of tremendous aid in job retention. 

This guidebook is designed to assist CETA prime sponsors in obtaining the maximum benefit 
for their participants and themselves from follow-up and follow-through activities; With' regard to 
follow-up, one of tHfcobjectives is to provide information about the procedures used by other 
prime sponsors and their, thoughts about what experience has proven effective for them. A second 
objective is to relate this experience to particular purposes for collecting follow-up data and to ^ 
provide guidelines for accomplishihgthose purposes. With regard to folLow-throygh, the objective* 
are to develop procedures for'using*follow-up data to identify problem areas and to develop 
strategies for using this information in offering supportive follow-through services to participants. 

♦The guidebook is organized for.q.uick usage and ready reference. After anoverview ofjthe 
essential task*or follow-up, action planning guidelines are given for each of'the tasks specified. 
The second section gives an overview^nd the relgte.d^uidelines for the essential tasks for follow- 
thrqugh. Reference materials to enable .users to carry out* the guidelines for these tasks are con- 
tained in the Appendices. An accompanying set ^worksheets provides for agency-specific analysis 
according to the guidelines. v - ^ - H . 



INTRODUCTION m 

• • • 

Purposes of the Guidebook - - , 

While collection.of Tollow-up data is mandated for reporting purposes, creative use of the 
fol tow-up concept can yield 'a number of other benefits. Many employment.and training agency 
staff persons are aware that they are obtaining little from their follow-up efforts beyond what is 
required and they are raising questions aboot hdw additional meaningful information can be gleaned 
for the agency and for participants! The possibility of using follow-up information for follow-through 
assistance for participants leads to questions about h6w the process can be structured to accomplish 
this function without expanding the level of agency effort and funding. , 

This guidebook addresses such questions. The guidelines offer principles by which to make, 
judgments o r determine a course of action; hence, they are called "action planning guidelines , 
They provide concrete strategies and suggested activities for relating those strategies to specific 
agency needs. - 

Many of the guidelines were derived from a synthesis of recent writings on the topics of follow- 
up and follow-through. However, not enough is available that is as specific and detailed as practi- 

• tioners in employment and traihing agencies need. Therefore, a number of prime sponsors were - . 
surveyed to obtain expanded information to share. ^ ' ; 

Fifty-seven requests for information were sent'to an approximately equal distribution of prime' 
sponsors in large cities, multi-county consortia, and balance of state groups across all regions. A 
later group of sixt'een requests was sent to prime sponsors in regions underrepresented in the num- 
ber of responses received f rorn the original mailing. Agencies were asked to share'the forms they use 
and to indicate on them the questions that have yielded information helpful beyond the repprtor.al . 
need They were encouraged to comment on effective (or noneffective) aspects of the follow-up 
process. A total of thirty-one responses was received; and insights from these responses are included 
with the guidelines. ' • N , • 

The guidebook is structured according to the recommendations of a number of employment 
and training sjaff persons who need a reference for quick usage and spot checking of specific tasks 
in the follow/up and follow-throughj>roce<>s. The guidelines are presented in task categories, and 

• a corresponding worksheet accompanies each task. 

»• 

' * j 

! Overview of Follow-Up and Follow-Through v y 

- ' Follow-up is a process of gathering job-related information from former participants and their 
employers. Nothing about the term "foltow-up" indicates any purpose for conducting it T his can 
be»a source of confusion, as people.may assume different purposes unless goals an d objective are 

■ agreed on and clearly stated. These goals and objective's, then give mining , to the>'tow-up .process 
because they state why people are carrying imit and what they -ntenA%do with the results. All 
tasks withifthe process follow logically op- the identification Of . tn I|fp and ° D J ectlves - 



{ • - ■ . 

The term "follow-through" is.nQt of the same' nature; it' indicates carrying out to an end what 
has been planned or begun. The goal jsjnHerent-to finish the wock identified earjier. But are all 
agency personnel in agreement on exactly when the work is completed? Is the agency responsibility 
discharged when a participant terminates? Obtains a job? Keeps a job for several weeks? Or several 
months? To answer these questions one is required to go back to Jhe originakchallenge: the work to^ 
be finished is . ^ 

"to assure th^t trainiilgiand other services lead to maximum employ- 
ment opportunities a<gd enhance self-suffiqency." 
(CETA 1973, Sec, 2, p. 1) ** + ' 

Clearly, follow-through tasks demand some attention. 



The tasks presented are not cast in any rigid .time pattern; in fact, each might be considered 
ongoing so that no decisions are labeled as final. Obviously, it is important to be flexible since the 
needs of agencies change, as do the needs of individuals. Furthermore, sincefollow-up and iollow- 
through come at the end of a chain of services to the participant, there is a need to adapt a? changes 
are made in the earlier service links. 

Nor are the guidelines intended to be a programmed system. Not all of the point** apply in 
every situation. Users iriust analyze the important elements in the processand determine the steps 
that should 'be taken locally. Major guidelines have been set in bold type to assist in working through 
them, and corresponding worksheets have been provided so that users can specify the ways in Which 
those guidelines can be implemented within thew own agency. < \ 

The oext section of the guidebook involves planning for action in the follow-up area. The - 
succeeding section explores planning for follow-through action. Readers are encouraged to research ^ 
both of these areas further, if their needs dictate, by consulting the references listed in the bibliog- 
raphy. , 
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PLANNING FOR ACTION 

An Overview of Essential Tasks for Follow-Up 
♦ * 

In order to assist employment and training agency staff in rmplemgnting a follow-up process, 
'synthesis of seven. essential tasks has been developed: A 



Folloyv-Up Task 1: * 
Identify purposes of follow-up activities for your agency 



Follow-UpTask2: / N 
Design a fQllow-up strategy to correspond with the purposes identified 



4> 
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; ' ' . Follow-Up 
Decide t>n procedures to 


T^sk3:. 
gar)y out the strategy 


\ 


• • \ ■ • 


\ Follow-Up Task 4: 
/ Dqtfelop aids for data collection 




r 


Follow-Up Task 5: 

Collect dSta * . 




r 


F6llow-Up Task 6: 

Analyze data ^ ■ , , 




f ' . , 



Follow-Up Task 7: 
Communicate information for use according to identified purposes 

* ■ ! £ 



ACTIO ^ PLANNING GUIDELINES 



. ' Foilow-Up Task 1 : 

IDENTIFY PURPOSES OF FOLLOW.-UP 
ACTIVITIES FOR YOUR AGENCY 



\ 



1.1 



1.2 



1.3 



1.4 



Identify the decision makers and information users who might have a need for information 
obtained through follow-jip activities. , 

i 

Form a planning committee of those who have responsibility for follo\v-,up and those 
identified as involved with.using the results. Also incjude some of the employers who may be 
providing follow-up data. The committee should operate under the leadership of a key Person 
with responsibility for coordinating follow-up activities. The committee s role should be to 
develop a list of information needs and rank the items on the list. In addition, this group 
should monitor the folloWup' activities in a general way to assure that the information gained 
serves the purposes identified and that those are reviewed periodically. ^ - * 

ft/lake certain that the follow-up program operatefas part of the agency's overall program and 
serves the agency^ goals? Identify purposes consistent with the scope of the agency s program 
and the needs and priorities within it. , .• , 

The viewpoint is sometfmes expressed that meaningful follows is a "luxury When time 
. and money are m short supply, quite often this area/which is not built irto tfie agency s cost 
formula gets sffbrt shrift. Jt is'important to think the question through in a i cost-benefit 
manner The effort can be justified only if the data generated leads to new insights that yield 
cogent and Helpful recommendations that ar§. implementedjf the results go unused or prove 
embarrassing and are "swept under the rug," the effort is wSted. A point to be pondered is 
that, if follow-up studies are important enough to be mandated, then their results should be 
important enough. to use. f. ' » ' * 

Consider a wide range of purposes to -identify those that have meaning for your agency, in 
categories such as: * 

• Reportorial (accountability) 

• Planning 

•■ Program evaluation and improvement , «; ' 1 

». • Laboc market information ^M* "J , „ < 

• Follow-through . * ■ . , . 
All Prime sponsors surveyed gather informatfon potentially helpful for reportorial, planning, 
and follow-through purposes. Approximately oqe-f.fth of the respondents gather program 
improvement information. Nope indicated gathering labor market information. 
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1 .5 Consider detailed aspects of each category of purposes. Use the information provided on the 
next pages to supplement your own ideas and resources. - < 

K ■ - ' f ' 

1.6 Once the purposes have been dfecided, write tHrnn as goatev Then write objectives related to each 
goal to specify the desired outcomes. Be sure to include a list of specific information needs,^ 
who needs that information, and when they need it. Try to wri^e the objective* as clear and 
concise statements. State them in measurable performance terms whenever possible. These will 
be the basis of the design of follow-up strategies, so it is important that they reflect the needs 
as precisely as possible^/ \ / * ' 
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Purposes of Follow-Up Activities * ^ , 

, » 

1. Reportorial (accountability): Jhis type of follow up provides evidence that current services 
rendered to participants are yielding results in relation to the established objectives and the money 
expended (i.e., effectiveness, efficiency, and relevancy). It allows agencies: . 

a. To comply wiilv Department of Labor legislative specificaticws for reporting - 

b. To provide support for the program ih response tb pressures to divert the resources elsewhere; 
to compete f&r resource allocations * 

c. To advocate that additional funding would be justified orthat existing funding shayfd tfe % 
allocated in different ways ; ■ 

d. To provideevidence that the pr^cjram meets-Community., state, a^d federal needs 

e. For programs with program-operator incentives for quality placements^nd job retention, to 
. verify placements and evaluate their qpality % ■ 

2. planning: This type of follow-up contributes to administrators' at^Mity to plan meaningfuHy on 
the basis of information. It allows agencies: 

a. To contribute to decisions about expanding, deleting, or revising existing programs ' ' ^ 

b. To find out how cost-effective program operatioTis are in terrfe'of, participant time, instruc- 
tional time, materials and equipment, and use of facilities 

c. To determine the number and kinds of employment of former participants and their 
geographic and occupational mobility . . - -^s^** 

d. To provide both internal and external justification for decisions 

3. Program evaluation and improvement: This type of follow-up identifies strengths and weaknesses 
in the program and solicits suggestions for improvement. It allows agencies: 

a. To evaluate the overall effectiveness of services by measuring participants' ability to perform 
satisfactorily on the job 

b. To .obtain feedback about the program from participants after thly have been in the work 
world t 

c. To record participants' observations about strength* and weaknesses of specific components 
of CETA services from their vantage point in^he work world 

d To determine program relevance. Are the^owledgeand skills learned in the program 
' actually used on the job, important on th<(jo|j^nd consistent with job practices? 
To identify needed improvements. in Training * 

f. To obtain employer input for us^in setting program priorities and giving direction for 
improvement . N ' v " ' 

g. To compare progf am 'standards with occupational standards 

h. To provide direction and Emphasis for guidance arid counseling 

i . « * 

4. Labor market information: This type of follow-up supplements other sources of labor market 
informatioa to be. used in planning and program improvement. It allows agencies: 

a. To obtain employer input for use in giving participants a better understanding of the wdrk 
world ih general and job requirement s in part icular 

b. Tp improve relations between the agency and private sector, business, industry, and labor; 
to inform and involve business, industry, and labor % 



• c. To maintain and supplement information files on employers regarding level ar^d* types of 
employment; hfring, support, and retention practices, and .overall needs and expectations 

d.. To learn how new technology is affecting the job market so as to adapt realistically 

- e. To identify occupational trends " s . ' 

■;f. To determine opportunities for job advancement 

' ' g. To^provide data to be used in calculating the supply of trained workers by job category 

5. Follow-through: This type of follow up enhances job retention and career progression.* It allows 
agencies: ♦ . '>< . , . 

. a. To determine how satisfied employers are with the work of forna#pprticipants 

b. To find out how satisfied former 'participants^are in their jobs ' 

c. To' determine how th^ agency could be of further assistance to fprmer participants in terms 
of counseling, placement, or referral; specifically if a person is, 

- not employed and needs job-search assistance \ ' 

, * * *• i employed ^ut having problerrapn the job; needs job adjustment counseling or 

- referral to a source of additional skill training - 

- employed fc>ut Struggling With personal problems such as transportation, child care, 
legal obstacles . * * 9 

_ employed but encountennrg problems based on sex, race, ethnic background, or 
handicap * * ; * 

d. To finq^out if former participants are naaintaimnglfcelf -assessment through an extension of 
their EmployabNity Development Plans and to encourage them to do so 

e. To identify needs for services not currently provided by the agency or available throfigh 
\ referral • • , ' - ' 1 




~T T 

* Sfce.the^second section of the guidebook for a detailed discussion of follow-through. 



FOLLOW-UP ACTION PLANNING WORKSHEET 1 



1.1 In our agency, the decision maters and information users who might havfi^need for infor- 
mation Qbtained through follovNjp activities ape: 



V 1 .2 (a) Members of our planning committee are? 



Their roles are: 



1.3 Our age'ncy's justification for expending effort on follow-up is: 
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1 .4 The purposes we should considerare: 
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1 .5 The detailed aspects^to !?e considered for each of these purposes include: 



) 
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1.6 Our follow-up goals and related objectives are: 



.a 




Follow-Up Task 2: 
DESIGN A FOLLOW-UP STRATEGY 
TO CORRESPOND WITH THE PURPOSES IDENTIFIED 



2 1 Develop a strategy that includes, for the goals and objectives listed in Task 1, thl methods 

chosen to attain the objectives, delineation.of the group to be studied, a.schedule, responsibih- 



ties assigned, resources to be applied, and plans for reporting and using the information-. 

2 2 Consider the advantages and disadvantages of various fojlow-up methods in light of the objec- 
tives- the cost time, and personnel involved; the response rate; and credibility of the data. 
(Use'the information on pages 15 and 16 for assistance as needed.) The methods usually con- 
sidered are personal interview, phone interview, or mailed questionnaire. Of these, the great 
majority of the prime sponsor respondents had chosen some type of interview as preferable. 

2 3 For employment and training agencies it is important to obtain some information on every 

former participant. However, identify a sample of the total population for portions of the study 
where possible within the objectives in order to save time and money. Consider the kind and 
amount of data needed. (Consult statistical references for information on valid sample selection.) 

2.4 Determine if information is desired from employers as well as former participants. I f 

2.5 Determine the time period(s) after participants leave the agency program wheni they -will be 
contacted Federal guidelines specify that follow-up contacts should be made with some 
regularity, but there is considerable variation among prime sponsors in the time periods used 

,., Itis important to review changes in legislation to ensure compliance with spec.f.ed requirements. 

•The thirty- sixty- and.ninety-day three-phase follow-up. was most commonly used in the 
IgencXrveyed but only 30 percent followed this cycle. The number of contacts/anfled 
from one to five, and the time periods varied from five day*to one year after programtermi- 
nation. m . 

Important factors in this deeision are, of course, the objectives and the resources^Or ins<ance ( 
if one of the objectives is to identify needs for support services in the early period of employ- 
ment a thirty-day contact might be indicated. If information about the agency prograrn is 
desired participants should have been away from it long enough to have gamed some peTspec, 
tive about it Job retention information would have to be obtained at a later time. Hqwwer , 
some follow-up contact should be made early enough after termination to assure a high proba- 
bility of locating the participant. m " ' 

2.6 Analyze the resources available, such as trained personnel, funding, physical facilities/and 
^equipment. Estimate program costs for each of these factors. 

Access to data processing' equipment is especially helpful, and usually becomes cost-effective 
whe^argeTmounts Of data are to be processed. Investigate- this possib.l.ty carefully A though 
the primfsponsors surveyed were not asked about computer use, 20 percent indicated that 
.they do use a'computeHor follow-up activities. 

2.7 Assign responsibilities and time lines to correspond with the strategies chosen and with the 
plans for'reporting and using the information.. 
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2.8 Maintain an awareness that the ultimate-usefulness of the follow-up effort depends on the 
validity and credibility of the strategies employed, as well as the care with which they are 
implemented. ,f 



\ 



1 




14 



... 



Follow-Up .Methods . y' 

1. Interview: Interviewing-^ collecting data by talking with people, either in person 

a. Advantages 

, (1 ) Questions requiring "yvdepth^nswers can be asked. 

J (2) Probing questions can be asked to clarify answers; this ensures that respondents 

' " understand the questions. " 

(3) Questions on complex and sensitive topics can be asked. , 

(4) Thelnitiative for completing the contact remains with the fojlow-up staff; this 
ensures a higher response rate than.other mfethods. ■ * 

(5) Unforeseen circumstances can be dealt with. . * 

(6) Reading and writing are not required of respondents. - y \ 

(7) Public relations can be enhanced effectively because of the personal nature of the 
interview.' . , " m ' ' 

^ (8) The environment can be structured somewhat. 

b. Disadvaptages 

(1 ) For personal interviews, the cost of transportation is significant, especially if 
-participants are widely scattered and not easily accessible. 

(2) Personnel'time costs are high; the process is time-consuming. § 

(3) Trained interviewers are necessary. Interviewertias ma^be introduced. 
Note: The first and second disadvantages can beTedube^through the compromise of a 

. telephone interview.-. \ -*j 

2. Mail questionnaire: A mail questionnaire involves sending £ list of questions to people and asking 
them to self-report and return the questionnaire b^mail. . ; ^ * + 

a. Advantages , ' • • 

• (1 ) The cost .is relatively low since responses are obtained without the presence of an ■ 

. - • interviewer. , 

(2) Large numbers of respondents can be reachad quickly,. . * # ^ 

(3) ' Respondents can answer at their own pace. ■ v 

(4) Geographically dispersed respondents can be reached easily. 

. (5) All respondents receive exactly the same questions, posed in the same way . 
{6). Portions of the response may be made anonymous if desired,- 

% x b. Disadvantages . # I. 

* (1 ) The rate of return may be quite low. Estimates of the rate. of retOrn varyTWl seSm 

■ Jo average about .40 to 50 percent. Reminder postcards or telephone calls increase 

the rate of return. ' 



SOURCES: Materral for this list has been adapted from the following. „ 

Stephen J Franchafc and Larry L. Smiley. Evaluation Handbook ■ Guidehnes and Practices for faring Employer 
Satisfaction with Training and Job Performance of Former Vocational Education Students (Co^mbus: The National 
Center for Research in Vocational Education, The Ohio Sr»te University, 1981). • ^ 

Stephen J Franchak and Biseo R. Ponce. Guidelines and Practices: Measuring the Training Satisfaction fffob 
SaStL of Former Vocational Students (Columbus: The National Center for Research ,n Vocational Educate. 
The.Oh'io State University, 1981). . • y • -<,..' 



(2) The, method is relajtvfly impersonal. • * n v • ' , + 

(3) Checking of reliability and validity of responses is limited. There is>no opportunity, 
to probe answers; ' « 

(4) The types and length of questions that.can be asked are limited because of chances 
for misinterpretation of the question or response., * .< • * 

(5) The method requires reading and writing. ^ 
' (6) ° Uncertainty is introduced as to whartompleted the form. 

(7) Because the questionnaire fnay be Fead entirely v before response^ questions asked 
later on the fornj may influence the answers to earlier questions. 

Note that some combination. of methods is also a possibility. Fo^further dj§cussion, the reader is 
directed to Mail and Telephone Surveys by D. A. Dillmari (N(?w York: John Wiley;' 1978). 



FOLLOW-UP' ACTION -PLAN^fTO WORKSHEET 

mcy is: ^ 



2.1 The overall strategy that^seems most appropriate fo 



X 



trateg 



our agency 



. x 1 



2:2 The follow-up methods most suitable for our use are: 



2.3 (a) We need to contact all former participants for information in these areas 
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(b)' We cobld consider a sample for information in these areas: 



2.4 For our purposes, information from employers (would / would not) be useful. 



2.5 'The following time periods for contact will correspond with our objectives and resource 
allocations: \ * 



2.6 The re^< 



ources we can apply to the follow-up effort and the related cost estimates are: 



2.7 We should assign responsibilities and time lines in the following way:^ 
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2.8 Steps we can take to assure validity and credibility in our follow-up activities are: 
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Follow-Up Task 3: 
DECIDE ONl*ROCEDURES TO 
CARRY OUT THE STRATEGY 



■ Considef how the procedures for implementing the follow-up strategy can be structured so as 
to gain the maximum effectiveness. For example, if personal interviews an? to 'be Conducted, 
what" procedure would be .followed for: . 

• Making contact with the employer or participant (telephone for an appointment?- . 
letter followed by a phone call?) • ^ 

' ' ' • Selectjng a desirable location for the interview 

• Grouping contacts in order to minimize time and transportation costs 

<• Maximizing uniformity ^ * / , 

• Eliminating intervjewer bias* 

If telephone interviews are selected, what procedure will allow for: ' 

* • Timing calls to make Ihegreatest number of contacts in the least time • 

. Arranging a time when it is convenient for the respondent to answer questions freely 

• Encouraging acceptance of the call by ^respondent 

If questionnaires are fo be mailed, can procedurgs be included for: 

• Prepaying postage for the response- 

• Reducing the impersonality by a cover letter or other means 

• Assuring that-the questionnaires will be noticed / 



For any method of follow-up, whaK^ocedure would be best for: y 

• Pursuing no-contacts or nonrespondents 

• Simplifying the rest of the process, such as pod ing responses into categories / 

• Coordinating the follow-up office process „ . 

* < » 

2 Be cognizant of the various rules and regulations protecting individual's rights, since these set - 
legal boundaries for the work. w . 

3 Employ some ^termination procedure to inform participants 6f the foHow-upWW they 
caTxpect and'to^ncoura* their participation. Participants should be ^JjJ^ 
follow-up program and the potential benefits for themselves and others. It should^ej^phas.zed 
that their response is important. . - , \ 

Some advance familiarity with the type of questionnaire they will 
view questions they will be asked is helpful! These measu^s can help to a lay possible fears and 
. mistrust later on a&fbuilcfa positive follow-up relationship from the start. 

4 Select and train staff who will implement the procedures. Account for the responsibilities 
Shout the entire process: development of aids for data collection, data col action itself 
SE I analysis and communication of the resulting information. Develop adetailed analys.s of 
the t^sks to-be performed to use as a guide in selecting and training staff. 
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Staff training can t>e made available through consultants, inservice workshops, or other more 
informal means. In all cases, the training sbould be as tasfc-specif ic as possible, and trainees 
should be given a thorough grounding in tfle objectives underlying tbe follow up. For example 
staff who will be interviewing former participants should have an orientation to their back- 
ground and previous experiences, and the need for empathy should be stressed. <See Task 5, 
•Guideline 3 for. further discission of this point.) >^ * 



Determine how the mechanics of the procedures will be handled (for instance, how tp obtain, 
file, and access* names, addresses, and phone numbers of tho^e to be surveyed and how to 
dupficate instruments). * 



6 Integrate these pr#cedyres with the time Ijnes ajready established tG detail a schedule for the 
follow-up activities. * , 




( 

FOLLOW-UP ACTION PLANNING WORKSHEET 3 

3.1 We can structure our follow-up procedures to gain maximum effectiveness by: 



j 



3.2 'Individual rights, rules, and regulations that affect our work are: 
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' ' 3.3 We can employ this pretermination procedure to inform participants about follow-up: 
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3.4 (a) The following staff members vyill implement the procedures: 



(b) Jbeir tasks will be as follows: 



(c) Training will be provided by: 



24 



r 



ERIC 



23 



3.5 We will'handle these process items in the following way: 

♦ 

i 

r ' 

oC 

3.6 The procedures decided upon will fit into our time lines in this way: 




Follow-Up Task 4: 
DEVELOP AIDS FOR DATA COLLECTION 



f 



4 1 Compare the options for designing or adapting data collection instruments on the basis of 
objectives data collection methods, time, and cost. Instruments are necessary whether mail 
or interview methods are to be used, so as to standardize the data collection and assure that 
. objectives are met. Virtually all the prime sponsors surveyed use instruments. specific to their 

■ own operation. These, of course, correspond with a need to reflect locally-determined objec- 
tives for the follow-up. ' . 

4 2 ' However it is often helpful to see what others in a similar situation have done. Review other 
instruments used in the field; inrtiate and maintain contacts with other similar agencies for 
the purpose o.f sharing information. Appendix A contains a sample of one of the most com- 
prehensive follow-up questionnaires for review. 

4 3 ' In developing or adapting instruments for data collection, adhere closely to the objectives 
identified so that each question serves at least one of the purposes. Also adhere to accepted- 
practices of instrument development. Material helpful on these^ints is presented in 
, Appendix B. . 

All employment and training agencies need to include questions about placement and questions 

• of a demographic nature. Of the agencies surveyed, 39 percent also asked about supportive 

' services, and 32.percent sought program feedback Consider these areas as well as others that 
correspond with the objectives identified. 

4 4 Determine the optimum length of the questionnaire by balancing considerations of informa- 
tion needs against ease of administration and response. As a general rule, a *»*™™**» 
used in an interview can be longer than-a mailed questionnaire without the respondent .finding 
it difficult. 

. Those responding to the prime sponsor survey use questionnaires that range from one to three 
• - 25?an?5 to 80 items, with three exceptions^ far more comprehensive questionnaires having 
twenty-two to twenty-seven pages and 107 to 140 items. Sixty-three percent of the question, 
- naWa* of one page. (As noted previously, almost all of tl* questionnaires ; reported were » 
. designed foradministration by interview.} The average number of items per questionnaire is 63. 

4 3- Select the type of question structure best suited for the kind of information being elicited. 
. *e bask types of question structure can be classified as open-ended, closed-ended {check-off \ 
' or short answer), or partially closed-ended (allowing for art "other" response). These are 

■ described^ nd analyzed in detail in material presented in Appendix B. 

* Almost all ®ime sponsor forms reviewed have mostly closed-ended questions. Fofty-six percent 
also utilize* comment space, and 14 percent also utilize some op^en-ended quest.ons. 

4 6 Word questions to maximize clarity and to be specific, concise, and objective. Care in word 
' choice can avoid a number of problems. Specific guidance in wording quest.ons is given in 
Appendix B, »' , 
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4^ Arrange items on the instruments for ease of response. For example, group questions with 
similar types of responses together (i.e„ open-ended, closed-ended), Start with a'series of 
questions likely to establish rapport with the respondent, and sequence the remaining ques- 
tions logically: • . \ 

4.8 Pay attentions format and appearance in designing instruments. For example, cHjality paper 
(preferably colored or with colored ink) shoutd be used if possible, and the typing and design 
should be attractive. Sufficient space to answer each question should be provided. 76'view the 
other considerations noted in Appendix B. 

4.9 As you design or adapt instruments, remember the needs of people who will finally use the 
results of the follow-up and include content that will be helpful and important to them. Inclu- 
sion of anecdotes or quotations from Respondents may help in interpretation. If suggestions are 
sought, ask for the underlying reasons as well. When asking for assessments about the'program, 
distinguish between the overall program and specific components of it. And within a compo- 
nent, say occupational skill training, be specific about the training^ourse. 

4.10 When requesting judgments or opinions about "satisfaction" with training or a job, be aware 
that reyapnses will be influenced by the person's values, n^eds, expectations, and objectives. 
This type of data, imprecise as-it is, should not be used as a means of measuring program effec- 
tiveness or quality, but should be used to point the way for follow through or public relations 
purposes. (For further discussion of this guideline, see Stephen J. Tranchak and Eliseo R. Ponce, 
Guidelines and Practices: Measuring the Training Satisfaction and Job Satisfaction of Former . 
Vocational Students (Columbus: The National Center for Research in Vocational Education, 
The Ohio State University,. 1981).) * 

-4.1 1 Wjien constructing questions, look ahead to how the possible responses may be used. For a 

questionnaire administered by interview, indicate when a response should be clarified orjDrobed: 
Decide which of the possible responses should be put into the categories identified. Sometimes 
this foresight will lead to restructuring of questions in order* to avoid problems later. Specificity 
can avoid confusion that might reduce the accuracy of the data. - 

One of the prime- sponsors surveyed sent copies of the manuals prepared by the Massachusetts' 
Department of Manpower Development, Division of Policy and Evaluation, and used to instruct 
staff in detail on the hse of each follow-up instrument of their comprehensive set. Such careful 
structuring should yield dividends in the resulting data. - ^^^^^ 

4.12 If employers are to be contacted, use the opportunity to makfe public relations strides on hehalf 
of the program and to elicit as much labor market information as possible. However, do not ask 
for information that can be obtained another way. Here are some topics and questions to be 
considered: ' 

Information about.the respondent: title, businefs address 
m • Information about the business: type and function, location 

• Information about employees: number, percentage'by sewage, minorities, etc. 

• Expectations of employees: training, educational and other requirements, weaknesses 
and strengths countered _ ~ , 

• Perceptions a£out the program: performance of former participants on the job, , 
preparedness in specific areas, recommendations for imptovecnent 

• ♦Potential cooperation: placements, on-the-job trajning*advisory committees 
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4. 1 3 If follow-through objectives have been icfe^tif ied, aslc questions designed to elicit needs for m 
-assistance and to encourage continued aelf -assessment and career progtessiort. 

4.1 4 Obtain input on the instrument from the planning committee and other staff who will be 
using the results. . t( / 

4.1 5 ' Prepare a master file of names, addresses, and phorie numbers for contact. If computerized data 
' storage is available, enter this information. 

« 

4.16 Pilot-test the follow-up instruments (and procedures) with a sample of respondents. This step 
may pinpoint problems that can be corrected early aqci increase the probability of gathering 
meaningful and useful information; Check for the following items: 

• Clarity; how well questions are understood 

• Wording; presence of a bias 

i Form, layout, and lengthTease of response 

• Usefulness of responses 

' • Predictability of contact with those to be que^ioned 

• Percentages of returns ~~ 

• Cost 
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FOLLOW-UP ACTION PLANNING WpRKSHtET 4 

4.1 (a) Our agency should consider the following advantages and disadvantages for designing 
our own data collection instruments: 



(b) We should consider these advantages and disadvantages for adapting instruments: 



4 2 Other agencies we should contact to share information are: ^ 

. / . ■ ■ ■■ \ 
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4.3 Key points for ^ to remember in our instrument development or adaptation are: ^ 
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4.4 ' (a) Our follow-up questionnaire will require the following approximate numbers^df items 
in the identified areas for questioning: 



(b) The number of items indicated above dictates the following in terms of administration 
and response: 



4.5 For the kinds of information our agency needs, the$e types of questions should be utilized: 



N 



4.6 Principles we should use in wording questions include: 



% 
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4.7 Our questionnaire items should be grouped in ihq following way: 



4.8 The format and appearance of our questionnaire should be as follows: 



4.9 The people.who will use the follow-up information would find this type ol response helpful: 

V 
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4.10. (a) We (do /do not) have a need to gather opinion or judgment data, 
(b) If we gather this dat£, we would use it in the following way: 



4.1 1 We have the following plans for categorizing and handling possible responses: 



4.12 We are interested in gathering the following information from employers: 

- • 1 



4.13 We are interested in gathering the followihg follow-through information: 



1 



4.1 4 We can obtain input on the instruments from: 



4,1 5 Out master file for contacts will be prepared in the following way :^ 



4.16 We (will / will not) need to pilot-test our instruments to check for: 
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Follow-Up Jask 5: 
COLLECT DATA 



5.1 Establish a detailed schedule for the follow-up contacts and associated agency" procedures. A 
sample sch'edule for a mail questionnaire is given on the next page. ^ 

5 2 For mail questionnaires, prepare the cover letter of explanation, unless this is incorporated in 
the questionnaire itself. Include a deadline or desired return date, and an assurance that the 
response will be confidential: A sample cover letter can be found on page 39. 

5 3 Conduct interview data'collection according to established techniques for obtaining the 
information effectively," Detailed material on this subject is contained in Appendix C. 

5.4 Implement contingency plans for no-contacts or nonrespondents. Considerable bias of the 
data can occur if these are not pursued and included. 

5.5 Monitor the datacol lection to ensure that it is proceeding smoothly.. 
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Schedule for a Mail Questionnaire 



r 



1. First mailing - alert car^s or lettd 

2. Second mailing - cover letters and questionnaires sent 'erid of first week 

3. First response analysis: " K 

a. Begin running count of returned and completed questionnaires. 

b. Attempt to find correct addresses for instruments returned because of incorrect 
address. 

c. Compile address list for third mailing of nonrespondents and corrected addresses. 

4. End of third week - third mailing ^ 

a. Reminder cards for nonrespondents • f 

b. Questionnaires to corrected addresses - instrument^ returned with "address unk novyn" 

c. Prepare list for fourth mailing. , « 

5. End of fourth week - fourth mailing \ , 

a. Reminder lettered second copy of questionnaire to nonrespondents 

b. Continue response analysis ' * i 



6. End of fifth Wek - fifth and final mailirig 



mai r 
toff i 



a. Send reminder card with cuibf f date to nonrespondents 

b. Prepare telephone survey listof nonrespondents 



Conduct telephone survey of nonrespondents. 




SOURCE- Adapted from Stephen J. Franchak and Janet Spirer, Guidelines and Practices forfollOw-Up Studies of 
Former Vocational Education Students (Columbus: The National Carter for Research in Vocational Education, 
The Ohio State University, 1978), p.'28. . , , 
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Sample Cover Letter 



Dear (Farmer'CETA Participant): 



The Central Employment and "Training Agency needs your help in gathering 
information to inrtprpve its program and to extend assistance to you and 
other participants. This is the fjrst of three questionnaires you will receive 
over the next year. Please fill out the form andjeturn it before June 30 in the 
preaddressed, postage-paid envelope. 

Your response will be confidential arYd will take only a few moments of your 
time. It^ou have any questions about the form/feel free to contact George 
Smith JB76-2984, in Centralis. ;^ rs ^y 



v 4 ' 



Thank you, 

•• . . . ) 

i Jerry T. Jones 
Director 



FOLLOW-UP ACTION PLANNING WORKSHEET 5 

5.1 Our follow-up contacts will be made according to this schedule: 



5.2 j^/e (will / will not) need a cover letter to include: 



5.3 The interview techniques W& should ^gree to use are: 
i * 



♦ ^ 
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*5,4 Our contingency plans for no-contacts or nonrespondents are: 



5.5 . We will monitor the data collection in this way: 



/ 



42 • 



ERIC 



43 



V./ 



Follow-Up Task 6: 
ANALYZE DATA 



6 1 Determine whether to use an automated, manual, or combination method of analysis. The rule 
of thumb is thatmanual data tabulation is cost-effective for*up to 100 average questionnaires. 
Above 100, the computer becomes rrfore efficient. ^ 1 

6 2 Define the statistical techniques necessary to analyze, the data. The object is to summarize the 
data for easy understanding and communication. Descriptivastatistical tools are of great use 
in summarizing the data systematically. A summary of some of these isjxov.ded in Appendix D. 

6.3 Post the responses as they are received, either on the computer or on tally sheets. f 
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FOLLOW-UP ACTION PLANNING WORKSHEET 6 
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Foljow-Up Task 7: 



COMMUNICATE INFORMATION FJOR USE 
ACCORDING TO IDENTIFIED PURPOSES 



7 Jt Refer to the list of goals and objectives identified in Task 1 and use the list of who needs specific 
•kinds of information as a guide for reporting follow-up results. Report to each user the informa- 
tion for use, prc^viding enough of the general' background to give the context. 

7.2 Prepare several versions bf the report according to the kifotmatioR and Jhe level of detail 

needed (and understood) by the 'user.' Franchak and Spirer (1978) list four types of follow-up 
^ reports commonly needed: 

• highlight report 

• executive summary 

• detailed report 
federal repc/t 



9 J * \ 

The highlight reotir;!; may be of use externally as a public relations tool,\as well as internally., 

- . f 

9 

7.3 Use information display methods to present datar in a.clear, effident, and interesting manner. 
An overview of graphic presentations can be found in Appendix E. 

7.4 Consider what will be appropriate reading time Jor each user. I n a study of repojts desired by 
educational decision makers, Brickell, Aslanian/and Ransom^ 1974) say that management 
personnel were more likely to request short reports (one page, three minutes reading time), 
while program and project specialists.were more likely to ask for medium (ten-pages, fifteen 
minutes reading time) to long (one hundre^i pages, sixty minutes) reports. 

7.5 Provide opportunities for discussion of the report's findings. 

7.6 Ask for feedback on the usefulness of the information provided and make adjustments to 
improve the follow-up process. 1 * f 
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f6llow-up action PLANNING WORKSHEET 7 



7.1 According to our list of goals and objectives, these people need the kinds of information specified: 



^2~~VVe will need to prepare the following versions of the follow^u^report: 



V. 



7.3 The information display methods *hat„would be of use to us in repprtir^ are: 



\ 



7 A T.he length/Of report we estimate td be appropriate for each' of our users is: 
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7»5 The areas in which we should be especially cautious in reporting are: 



r 



7.6 Our plans to ensure an attractive report include: 



7.7 Our plans for discussing the report's findings are: 



7.& Wewfill obtain feedbackon the*follow-up process bye 
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„„. Summary 

■ An effective follow-up process begins with careful identification of the purposes of the 
'follow-up activities for the agency. A strategy is then designed to correspond with the purposes 
identified and procedures are.identified to carry out the strategy. Since a follow-up process 
involves gaining information from data, the next tasks are to develop aids for data collection, 
collect the data, and analyze the data. Finally, the resulting information is communicated for use 
according to the identified purposes. The follow-up system must be evaluated with respect to its 
effectiveness in achieving the purposes. 
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. An Overview of Essential Tasks for. Follow-Through* 

iWtollowing set of four essential tasks has been developed few implementing a follow-through 
component for an employment and training agency:* 



Follow-Through Task 1: 
Identify areas for follow-through activities 



Follow-Through Task 2: 
Identify available means of participant reinfQrcement 



Follow-Through Task 3: ' 
"Determine effective procedures for delivery of follow-through services 




FolJoyv-TftroQgh Task 4: 
ent procedures * 
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' # Many of the ideas in this section were taken from Robert E. Campbell, Claire Ho, Catherine C. King-Fitch, and 
Kenneth L Shellburg, Follow-Through Services: A Missing Link to Employment for the Disadvantaged (Columbus: 
Tl?e National Center for Research in Vocational.Education/The Ohib State University, 1981). 



ACTION PLANNING GUIDELINES 



Follow-Through Task 1 : 

IDENTIFY AREAS- FOR 
FOLLOW-THROUGH ACTIVITIES 



: ~' ^ 

1 1 Define goals and related objectives to clarify the aims of the follow-through program. Consider 
the statements reprinted from Campbell et al. on the next page as an aid in making decisions 
abou£ goals and objectives relevant to your agency. 

1.2 Conduct a participant needs assessment using opportunities providedTby regular job placement . 
, and follow-up contacts. The following opportunities are advantageous: 

• The termination interview presents'a chance ,to anticipate (and perhaps avert) possible 
participant problems; reduces the risk of losing contact with the participant; and ( 
acquaints the participant with available follow-through services. - 

• Thirty-day follow-up provides an opportunity" to identify problems that have surfaced 
in the all-important first month on the job, when the most adjustment is required; if 

a job has not been obtained or retained, it identifies the need for support before the 
' situation has bedtete excessively negative. ^ 

• Later follow-up contacts ass,ute th*e participant that the agency is offering support on 
"a continuing basis, and tend to elicit problems of a different nature\than those 
encountered immediately. 

13 ' Instead of simply using the information usually collected during the follow-up process, 
• structure the instruments used to'reflect the objectives'of the needs assessment. (See Follow-Up 
.Guideline 4.13.) • ' ' * 

1.4 Expect needs or problems related to the following areas: 

* * * 

• job adjustment 

• job satisfaction # _ . , 

• occupatfopal skills ' 

• job search * - * «► 

• persohaf Jife ' 1 * > • _ 

• career progression 

• personal image 1 ^ 

A detailed breakdownof job adjustment aspects that have provided difficulties^ former 
participants is provided on page 58. , 
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Functions of Follow-Through Services 



Continued job placement assistance can help jobless participants. Program terminees who do 
not find employment or who do become employed and then quit or* lose their jobs can benefit from* 
follow-through placement assistance. The service can be useful in helping participants identify job 
opportunities and instructing them on job-seeing skills that would increase their potential for stable 
employment. . ' " 

Follow-through services can help participants obtain further education and training for career 
development. Some participants who complete training and obtain employment want to advance in 
their careers, either within their current jobs^or through other job opportunities. Frequently, further 
education or training provides the means for career progression. A follow-through service ppogram 
can help participants identify education and training opportunities that will help them achieve their 
career goals, ' 

Follow-through services can help participants strengthen their self-esteem. By helping partici- 
pants to obtain, adjust to, and retain employment and thus to become established in the labor market, 
follow-through services can contribute to the development and strengthening of participants' self- 
esteem. This stronger sense of self-vyorth may lead to their becoming even more stable, productive, 
and satisfied members of t;he work force. * 



nFollow-through services can aid in reversing participants' lon^-term problems. Often the char- 
acteristics that impede a participant's ability to obtain and retain employment cannot be reversed in 
the short time period during which training takes place. L6nger-term intervention than is provided 
in employment and training programs may be needed to help resolve such problems. Follow-through - 
services have the potential for helping participants over an extendled period of time to improve their 



long-term employability and careef^progression/ i 

Follow-through services can help to protect the training investment. Employment and training 
programs are expensive. Although there are no official figures, local programs unofficially estimate ■ 
that annual costs per participant range from $^00 to $10,000, depending on the size and kind of 
program, length of participation by the client, the services provided, and so on. This investment in 
training is lost when program completers fail to secure and retain employment. Follow-through 
services-are expected to increase the probability of job acquisition, retention, and progression, and, 
in turn, to protect the monies that have been invested in training. 

Follow-through services can help to redude program repeaters, CETA program operators have 
found that many clients complete training only to-reenter the programs and receive, more training. 
Some clients do this repeatedly (the term ,; CETA junkie" has been used to describe these "recycling" 
participants). Many reasons have been advanced to explain this phenomenon: fear of trying to 
suryive in a competitive work environment, poof attitudes toward work, inability to find employ- 
ment, inability to cope with job stress, and the program's failure tq*ensure participants' success in 
the work world. Undoubtedly the reasons differ from one person to another and many or all may 
apply to a given individual. Many problems such as these can be averted^r resolved by providing 
timely postprogram assistance. Follow-through services, such as job seSrrfch assistance, work orienta- 
tion, job adjustment counseling, and similar services, can help to provide the transition from training 
to stable employment rather than to repeated training, y 




SOURCE: Campbell et al. a pp. 13-15, 
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F.ollow-through services can provide valuable feedback for program improvement. Staff 
members who provide follow-through services are in a unique position to obs&rve the outcomes of 
emploVoierTTand training programs and related services. Their direct interaction with clients and 
employers in the labor market presides a view of how successfully the training mission is being 
accomplished. By observing the degree to which clients-and, in turn, programs-have met their 
goals, follow-through service staff can provide evaluative feedback t* the^fbus program compo- 
nents'. Such information can be used in the analysis and improvement services, not only those 
within the training programs but those ir/the follow-through program as well. 



Follow-through services can improve the Image and credibility of CETA programs. When 
employers former and current participants, and members of the community observe that programs 
are concerned with the posttraining needs of participants, then the image of those programs may 
be enhanced Follow-through services demonstrate a commitment to helping clients become estab- 
lished productive, and satisfied members of the work force. This kind of commitment supports and 
strengthens the image of employment and training programs as contributing to the wellbeing of the 
workers, the employers, and the community at, large. \ 

follow-through services can helped produce societal benefits. To the extent that follow-through 
serviceshelp clients become established and stabilized in the labor market, soc.ety gams in a number 
of ways Psychologically, society gains through the knowledge that the clients have become tax- . 
payers not tax users.-aHd that they are contributing to the nation's productivity, not draining it of 
its resources. Economically, society benefits from the reduction of transfer payments and the increase 
in collected taxes, consumer spending, and national output. 



/ 
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Job Adjustment Needs 

personal Work Habits 

■f Work time: punctuality; policies regarding lateness] absence, time off, leave; recording work time; 
staying on the job . ^ / 

• Qualitative standards: accuracy, carefulness, neatness, artistry 

• Quantitative standards: output, pace, meeting deadlines - 

• Responsibility: diligence, following through, initiative, volunteering, mature deportment 

• Attitudes and values: willingness, flexibility, showing interest and desire to learn, integrity* 

. ^mfmariagement: setting goals and objectives, prioritizing work, using time well, completing 
work on time 

Interpersonal Relations - * v 

• Relationships with supervisors: expectations vs. reality, communication, asking questions to get ^ 
-answers accepting supervision, following instructions, accepting criticism ; 

. ReSships with coworkers: getting along, fitting in, teamwork understanding interrelation-, 
ships, positive attitudes, helping others, coworkers as a source of help and support 

• Dealing with problems and tensions on the job 

• Dealing with prejudice 

Organizational Adaptability , 

• Of ficial policies and rules: knowing company policies, rules, procedures t, , 

• UnXiTruIes: learning the unwritten rules, protocol, '/party line," sources of inside infor- 

• UnioTand employee organ iza&ns: rules, policies, relationship with the-work place ^ 
. AS^niment: criteria for raises and promotions, informal networks; importance of outward^ 

image, flexibility, dealing with change, attitude v ^ 



Job Satisfaction 



• Need for affective rewards: recognition, approval, sense of contribution and responabilrty, 

of scheduie. placein *. "pecking o^V'roHins with 
.■ 'tUSS^SL, and their impact on feelingeabou, work and ]ob: famil V background, sejf-imege. 

• SiSSSSc, on the iob: fafniiv. persona,, situational, heaith. legal.child- 

care, financial t , * ; 

• Money management and budgeting 



Problem Solving - 

• .Importance of early detection of problems 

• Identifying causes and symptoms , <. " ' . 

• Problem-solving^steps • - ; 



SOURCE: Campbell, et al. f pp. 38-39, 



FOLLOW-THROUGH ACTION PLANNING WORKSHEET .1 

* 1 .1 Qur follow-through goals and objectives arer « 



1 .2 Our plans for participant needs assessment are: 



♦ 



*T.3 -We can rfeflect the objectives pf the needs assessment in our instruments^: 



1 .4 The needs we know we will need to deal with are: 



Follow-Through Task 2: 

IDENTIFY AVAILABLE MEANS 
OF PARTICIPANT REINFORCEMENT 



2.1 Use the results of the needs assessment to direct a search for and development of means of * 
follow-through support. Try to find a way, or a combination of ways, to meet each need , 
identified. 

2.2 Investigate the relevant rules and regulations providing the framework within which rei^orce- 
ment can be provided. In general, the*types of follow-through services that can bQ offered by 
employment and training agencies include counseling andreferral. 



erJc 



2.3 In considering the use of counseling as a means of follow-through reinforcement, distinguish 
^etween group counseling and individual counseling in terms of potential effectiveness and 

cost. Consider when each might be used to advantage. / • 

Group counseling techniques: ^ . . 

• Are less costly because several participants are servecfsimultaneously 

• Can reap the benefits of peer interaction, as participants can learn from each others' \ 
experiences and are often more receptive to suggestions from peers than from others 

• Can contribute to ongoirjg assessment as individual problems surface in the group process 

Individual counseling; 

• Can be specifically 'tailored to the participant's heeds 

' • Can'be provided at the proper time to be relevant and perhaps avert crises . 

2.4 In considering the use of referral as a means of follow-through reinforcement, provide for 

; identification of specific services available to former participants both within and-outside the 
employment and training agency. One useful outgrowth of such an identification process is < 
the development of a support services referral handbook. 

. \ * 

Referrals can be made "in-house" for assistance in job search, job adjustment, career pfenning,. 1 + ^ 
> arid even occupational skill training to the extent that these are considered of a nonprogram ^ 
service nature. The prime sponsor needs to determine, for instance, if a former participajrtTttuld^ 
sit in on a group discussion taking place in the work maturity skills classes as a means bt rein- 
forcing some job retention ideas; or if the participant could gain access to individualized curric- 
ulum materials to brush uj^en an occupational skill not adequately learned in the service period 
and proving difficult on the job; or if the participant could make use of materials about employ- 
•menf opportunities as they are received in the placement off ic^. Many possibilities of th^ type \ * 
could be provided without significant cost or effort, once identified. * 

Referral of the former participant to outside sources of assistance offers tremendous potential 
if a comprehensive job is done.of identifying and categorizing those sources. Institutions and 
agencies exist that can provide: + 

• Career planning iK * 

• Occupational skilf training 

• Help with personal problems * * * 

• Job s'earch techniques * V ( ^ 

More detail on these sourqes 1s contained fn the materials for Task 4. 

h 
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Plan to make continued use of the self-assessment techniques participants learn in the course* 
of the agency programs. Counselors and participants work with an employability development 
plan on an ongoing basis throughout thS service delivery period. During this period; emphasis 
on establishing self-assessment patterns to useafjer terminatiqn can yield important follow- 
through benefits/Participants should realize that the same techniques of establishing objectives/ 
measuring progress toward those objectives, and reviewing options are life skills. 

Where corjipetency -based curricula are the mode of service'delivery, Evaluation checklists and 
appraisal forms arerused frequently. Some of these can be used as continuing self-check aids 
later on. ^or example; checklists from a work maturity skUls progr'air^are most applicable as a 
systematized method ot reinforcing appropriate work behavior. Thus a retention attitude is 
built on the foundation of a concept of "success" as involving retentitonpf employment and 
'growth toward career goals. - , , - ^ ^ Y 

Utilize employer contact as an indirect means of participant reinforcement. Employers have 
mdicatedfcthat they have a major problem io retaining^disadvantaged workers. They nepd tt> know 
more about the supports needed to maintairOiew, and especially disadvantaged^ employees in 
jobs. All programs involving employer contact should be explicit about how empioyers can^ssist 
in promoting job retention for their own as well as the employee's beqef it. 

Employer feedbackl&n job-performance and potential problems can be obtained during follow-up 
cpntacts. Also, information about expectations , can be gleaned for usejn counseling situations. 
, Another advantageous technique is to facilitate the establishment of aVegular review between 
employer and employee «pf the employeeVextended and detailed £mpJoyabHity development 
plan. This technique removes the agency, from the triangle once the-relationship is established 
ancT^sters a "let's workfon this together" attifuctethat can be quite fruitful* 

Determine the level of funding available for the follow-through effort in the context of overall 
program goals and levef of commitment .to the idea of follow-through. In the study of sixty-five 
prime sponsors conducted for, the Campbell et al. work cited, tf,was discovered that an over- 
whelming majority of the personnel in.the programs had favorable attitude?; toward follow- 
through (even if they weren't doing it) because of the benefits they felt would be derived by 
the clients, by the staff, and by the programs themselves. "The cost in dollars, time, and effort 
of the^ignif icant number jof participants who complete empl^ment and training programs ahc\ 
then fail to secure and*retain jobs is an important factor. ^""^ 

Each prime sponsor must weigh carefulfyOthe potential benefits of follow-through services 
against the barriers of no designated funding, absencq of central administrative enccujragement, 
and program rewa'rds derived frt>m inAnjediate^lacemenf on termination rather lhart from job . 
-stability. WJiile some follow-through actb/itles can be initiatecLthrough existing^ mechanisms at 
virtually no^cost and others can be-added in an extremely.cost-effective manner, a significant 
expansion of ffllowcthrbugh services does demand a commitment of time and, therefore, money. 
An ofteti-cited barrier to the provision of follow-through services is insufficient staff to handle 
the increased demand. 
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FOLLOW-THROUGH ACT I ON ' P L A Ntyl N G WORKSHECT 2 

•2.1 We-will meet the following needs in these ways: 



m 



2.2 The rules /nd regulations relevant to our follow-through activities, 



are: 



% 2.3 ' (a)' We will-use group counseling under these circumstances: 



63 



9 

ERJC 



53 



(b) We will use individual-counseling under these circumstances: . , • 



2.4 iA/e will identify the following types of referral sources: 



c 



2S The self-assessment techniques we can^extend are: 



it * I*- i 



2.6 We can work with employers on follow-through by:' 



2 7 We will commit these resources to the follow-through progr^rn^y 
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Follow-Through Task 3: 

DETERMINE EFFECTIVE PROCEDURES FOR 
DELIVERY OF FOLLOW-THROUGH" SERVICES 



3> 



Establish a systematic delivery system for follow-through services. The Campbell et al. study 
revealed that even the few prime sponsor agencies providing follow-through services do not 
have a systematic delivery system, and the services' are limited in^scope and duration. Essentially, 
a program component deemed worthy of inclusion at all should be integrated into the program^ 
systematically: ** 

3 2 Select and train staff who will implement the procedures. Use a detailed analysis of the tasks 
to be performed as a guide in selecting and training staff. (Such an analysis was developed for 
the model in the Campbell et al. work and is prpvided in Appendix P.) It expected that some' 
j of the staff functions will correspond to those already underlay for purposes other than 
follow-thfough. * 

3 3 ''Institute procedures that will contribute lljoTrow-thro&W»ng an integral part of the overall 
program with the focus toward job stability*rather than'sifhply job placement. Wherever possible, 
in the other program components, include follow-through concepts and techniques as part of the 
ongoing curriculum. The curriculum outline for a work maturity skills program is included in 
Appendix G as an example. u ■ % ' '* , . 

3 4 Build upon the current CETA philosophy and regulations, such as those that call for conducting 
individual assessment, developing and implementing an employability development plan forj^ 
each participant, providing training and placement services„providing appropriate support • 
services to help- participants complete training and. retain employment, ana conducting follow-up 
studies of former participants (Campbell et al., 1981). • ^ 

3 5 Schedule procedures within the"followrthrougti process to meet needs as-promptly as potsible 
and to allow for information obtairied to be used in a timely way for other purposes, su<\h as s 
program improvement. 



3.6 



4rovk 



3.7 



rrovide for continuity and consistency of service. Avoiji the adverse effect on participants i 
shuttling them from one counselor to another. On the other^and, encoifrage participants to 
develop adjustment skills to promote self-sufficiency and independence rather than a depen- 
dency on the support system. ^ , * # 

Establish the time period within which follow-through services will be made available to 
participants. The services are likely to be in greater demand in the immediate postterraination 
months than later on. Toward the end of the period plans should be made for other assistance 
if it is needed ' • 

> 

3 8 Build cooperative relationships with institutions and community organizations providing 
' • services to which you might wish to refer participants. These would include, among others: 

• Vocational schools , 

• Postsecondary schools such as universities, colleges, technical schools , 

• Social service agencies 

• State employment services 

• Public assistance departments • , r 
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• Vocational rehabilitation 

• Libraries and other resource centers 

• Churches v < . V 

\ 0 1 - 

Establish vehicles for information exchange. The ideal would be to establish a council for 
coordinated. information exchange among all groups providing services of this nature. 

3.9 Develop and maintain a file and perhaps a handbook of services to wl\jch participants can be 
referred. Include the name, address, phone number, a description of the service, procedures 
-to be followed, and background information so participants .can be given an idea of what to 
expect. Also include the names of contact people. Sometimes it is* helpful to make the contact 
directly or to follow up on a participant's coatact. ■ 

3.10 Keep careful records of contacts, dates, and types of services rendered for each former, 
participant. This is important for efficient service and to ensure that contact is maintained. 
If computerized data storage is an option, those records cao be programmed and«updated 
easily along With the rest of the participants file. Alsp, this minimizes overlap of fjle injjpr- 

* mation within different departments of. the same)agency. ' 

w- 

3.11 Plan to use the records and other solicited feedback ro evaluate the follow-through program 
for the purposeof improvement. 
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FOLLOW-THROUGH ACTION PLANNING WORKSHEET 3 



3.1 We can establish;? systematic drtivfery system in the following w^y: 



atic drti 



VI 



3.2 (a) The following staff members'will implement the procedures: 



V. 



(b) Their tasks will be-as follows: 



V 



(c) Training will be provided by. i 



1 
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3.3 We can contribute to a fosus on job stabiNty byr 



3.4 The cu rrent CETA v components we can build on are: 



3,5 We need to consider'the following in scheduling: 



3.6 We can provide continuity and consistency by: 



3.7 The time period for our follow-through services will be: 
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3.8 The insjituti^s and community organizations with whjSh we should Wild cooperative 
'relationships are: m 



/ 



w5r 



>i 1 



3.9* Our information pn referral sources will be handled by: 



3.10 Our recordkeeping will be handled by: 



-• Follow-Through Task 4: 
IMPLEMENT PROCEDURES 



4.1 Implement all procedures with the follow-through goals and objectives as overall guides. The 
participants should feel the presence of a personal support system, and {he system should- prove 
itself ultimately by increased job stability. * , c 

4.2 Implement group counseling through techniques such as: 
■ , • Conference or group discussion 



• Training groups or sensitivity training 

• Role playing 

Gaming . n 

• Simulation , • v 

• In-basket technique 

• Case studies r* 4 

• Audiovisual^ 

• Lecture ' > . 

Each of these techniques is detailed in Appendix H, page 169. 

4.3 Implement individaal assistance through: 

• Individual counseling 

• Dialogue with employer 

• Intervention or advocacy 

• Programmed or computer-aided instruction 

• Modeling 

• Exploratpry experiences 
* - • Selective placement , 

• Referral . < . 

• Reading lists and printed materials 

* ■* 

These options are detailed in Appendix H, page 1 # 73. , 

* 

4.4 Implement career planning assistance by: 

• "In-house" group assistance 

• Individual assistance * * 

• Referral to commuhity services 

See Appendix K, page 175, for more information on these methods. 

4.5 Implement referrals to education and training programs by: 

• Helping participants identify educatiori*and training needs 
•-Identifying education and training programs 

• Linking participants with education and training programs 

• Helping participants implement education and training programs 

Appendix H, page 1 77, expjains these ideas. 
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4.6 Implement referrals to support "services by. 

• Helping participants identify personal problems 
* ' • Directing clients to sources of assistance 

n Appendix H, page 179, gives further detaijs. 

Implement job search assistance. (Related guidelines are contained in Jb% Placement in 
Employment and Training Programs, Technical Assistance for Occupational Skifts Training 
Project, Office of Youth Programs, Department of Labor, developed by the National Center, 
for Research in Vocational Education, The Ohio State University, 1981 .) /% 

4 8 Recognize that some of the former participants will need assistance in more than one area. 
Schedule these as possible to address each need in a timely way and yet not overburden 
participants with remedies applied all at once. ■ . 
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FOLLOWrTHROWGH ACTION PLANNING WORKSHEET 4 

4!1 The goals and objectives we will use>as a guide for procedure implementation are: 

* i 

■ ' \. \ ■ ■ ' ' . 

w ■ ' ' • 



4.2 In our group counseling we will use these techniques: — 



4.3 We wilfprovide individual assistance through: 



V 
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4,4 We will implement career planning assistanceby: 



4 V/ 



4.5 Our referrals to education and training programs will be through 



.4,6 We will implement referrals to support services by: 



4.7 We.will irpptement job s£arc t h by: 



• v 
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Summary 



Impietrrenting a follow through component of an employment and training agepCylprogram 
requires, first, id^ntifym^the areas suitable for follow through activities. Second, available means 
of participant reinforcement must be identified. After effective procedures for delivery of follow- 
through services have been determined, the procedure^ can t>e -implemented for the benefit of 
participants and the agency alike. 



o # 




. . . • APPENDIX^ 

1 ' ' ' SAMPLE FOLLOW-UP QUESTIONNAIRE 




CETA FOLLOW-U^vEVALUATION PROJECT 

FOLLOW-UP QUESTIONNAIRE; YOUTH PROGRAMS 

DEVELOPED BY: - 
' RESEARCH AND PROGRAM DEVELOPMENT DIVISION 
DEPARTMENT OF MANPOWER DEVELOPMENT 



Every box should be filled in. If a que§tion is not answered, do not leave the box blanl^nstead, fill it in with one 

of the fallowing codes: % . . ,. ',<. 

— 1 If the question is not applicable % 

i * / * t ' 

-2 If the respondent refuses* to answer 

4~ 3 • If the response is missing.or the respondenfcioes not know 

v \ • . 

Interviewee's Name: . I — : . — 



Home Address: 



Home Phone Number: 



SECTION \: CONTACT INFORMATION 

l" 2 3 8 



l.D. Number 



r 



11 



Date Interview 
tompleted 

Contact 



12 



14 



Mo. Day Yr 



Date 



Contact 
Made 



Interview 
Compfeted 



Date of , — — 

Termination Mo. pay Yr. 

Reason for Beginning/ 
No Contact/ / Ending 
' Time 



iruervievrei 




A 






















/ 


* 




















1 


% 



































Final Contact Status: 
T5 16 



19 20 



Terminee Contact. 

01 - Contacted/Interview • 

completed by phone 

02 * Contacted/Interview 

completed at home 

03 = Contacted/No information 

04 * Not contapted 

Total number of phone calls j 
"and.home visits **' V 



17 



18 

•Why No Contact: 

01 = No phone no. at intake 

02 = Incorrect phone no. at intake 

03 = Disconnected phone 

04 = Unpublished phone no. 

05 = Moved: address Unknown. 

06 = Participant RTA 
0J =*Coufd not contact 
08 = Language problem . 
-1 = Not' applicable/ 



% 



Terminee contacted 



SOURCE. Glen Schneider and Jeffrey Zornitsky. data Collection Materials for Follow-Up Evaluations'^ Title II B 
and YETP Youth Programs. (Commonwealtrtof Massachusetts. Policy and Evaluation Division, Departr lent of 
Manpower Development, 1979). * , ; V % > 

Q1 ! 



SECTION II 

;2i 23 

Agency (primary provider of services) 



PROGRAM OF TERMINATION -IDENTIFICATION INFORMATION 

^ 24 26 

Program of Termination 



27 28 



29 30 



31 32 



Program funded under 

01 = Title 1 1- 8 

02 «* Title IV - YETP 



IV1a>or service received * 

01*^ Skill training 

02 = OJT 

03 = Work experience ' 

04 = GEO 

05 = Basic education 

06 = ESL * < f 

p7 - Employmejifr/Placement 
(transitional) services 




{ Questions 29-30 an •32 refer only to those 
program? funded under Title If-B) , 1 

Educational Linkage' ^ 

01 - In-school Program 

02 = Out-of-school Program 

(Questions 33-34 thru 47-48 refer only to those 
programs funded under Title iv\ YETP) 

Educational Linkage. ' 

01 " In-schopl Program 
s 02 = In-school Program — operated under 
LEA (22%) agreement 

03 = Out-of-school Program 



35 



36 



(If termmee wds in a YETP In-school Program, 
response 0^ or 02 to question 33-34) 

Component 

01 - Career Employment Experience (CEE) 

02 = TransitiopaJ Services 

' 03 = Career Employment Experience AND Transitional Service 
04 55 Transitional Services (non-income eligibles only) 



(If terming was in YETP In-school Program)' 

^ v 
Type(s) of services received* (Record up to 3 responses. Rank tn terms of priority.) 

37 38 . *' 



39 40 



01 = OJT 

02 ■ Wprk expertence 

03 3 Transitional services 



41 42 




(Questions 43-44- thru 47-48 are applicable if the termmee was in a YETP Out-of-school Program, see question 33-34.1 
Services received in Out-of-school Program: (Record up to 3 responses, "Rank ir\ terms of priority.) 

* \ 



43 44 



-45 46 



61 = Skill training * , 

62 = OJT 

03 - Work experience ✓ . 

04-GED - 
05 = Bdsic e'ducation 
06* ESL 

07 K Employment/Placement (transitional services 



47 48 



. \ 
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SECTION HI: INTRODUCTION 

A. Background Information - The following questions (49-50 thru 67-68) apply to the 
period just prigr to the time of prograjn enrollment. 



61 62 



65 66 



OTHER. 

06 = fr Chmese 

07 = Portuguese 

08 - Cape Verdean 

09 = Haitian French 

10 = Armenian 

1 1 = Russian m 

12 - Vjetnamese 

13 = ' 
14= , 
15 = 



Including yourself, how many members 
of your immediate family did you live 
with at the time of enrollment 7 



At the time of enrollment, did you 
earn moy of the income ir^your 
household? 

4 * 

01 = Yes 

02 = Nos 



B. Current Information 

69 70 





I 
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I, 


I 



Including yourself, how many members 
of your immediate family do you 
currently live With? 



I Do you currently earn mos't of the 
J income in your household? * 



01 = Yes 
02= No 



49 50 




51 


&2 " 


» I i 


Sex: 






- - II 


01 = Male 
. 02 = r-emale 

4 






53 5# 


55 


V 

56 




Years of education 
completed 














57 58 




59 


60 


. 1 1 


Race/Elhnicity: # 








01 = White (Non-Hispanic) 

02 = SlacklNon-Hispanic) " 

03 = Hisptffe 

04 = Asian and Pacific Islander 

05 = American Indian/Alaskan Native 






• 







63 64 



67 68 



Age 



MantaJ status. 

„ 01 = Married 0 

02 - Never married 

03 = Widowed 

04^ Separated/divorced 



Native language 

01 - Spanish 

02 - Chinese 

03 = French 

04 = Italian 
0&= Portuguese 

06 - Greek 

07 - English 

08 = Other 




Did that include your parents 7 



01 - Both 

02 * Mother 
' 03 = Father 

04 = Neithe 

0 v 



Excluding yourseff, how^nany dependents 
did you have at the time of enrollment? 



71 72 







75 76 







Excluding yourself, flow many dependents 
do you currently'have? 



> Does anyone else in your family currently 
work? * 



/ 01 = Yes 
- 02 = No 



83. 



* 



9 

ERIC 



n 



1 2 
0 6 



I D. Number 



SECTION IV: PRE PROGRAM EDUCATIONAL HISTORY 



10 



13 14 









3 

r t 


17 


18 


' 




* 





Did you have a high school diploma 
at the time you eprolled in the 
CETA program 7 

01 = Yes (If yes, continue through 

question 13.14.) 

02 - No ( If no, skip to question 1 5-16.) 



(If received GED). 

What was the last grade you completed 
^ while attending school 7 ' , 

(Skip to Section VI) 



11 12 



(If yes) Did you complete twelve years of 
education in high school or receive a high school 
equivalency (GEO) diploma 7 

01 - Completed 12 years (If 1 2 years, skip to 

Section VI) 

02 = Received GED 



15 16 



(If terminee had not received a high school 
diploma - question 9-1 0): 
What was the highest grade you complete.d at 
the time of CETA enrollment 7 4 



At'the time you entered the CETA program, 
were you enrolled in school 7 

01 - Yes (If yes, skip to question 39-40.)- 
a 02 - No (If no, continue.) v » 

The' following questions (19-20 thru 35-36) apply only to those respondents who were not enrolled in school 
at the time they^fntered the CETA program. 

19 20 

How old were you when you last 
attended school? ' 



21 



23 



What date did yo/i last attend school? 



yoa 



24 



26 



(Calculate and code) 
Length of time out of school 
prior to CETA enrollment. 

. Date of enrollment in CETA 

program 

Weeks out of school 



27 28 



Mo< Day Yr. ^ 

What type of school did you last attend 7 

01 = Elementary School 

02 = Junior High School 

03 - Comprehensive High 

04 = Private Trade High 
05- Regional Vocational 

06 - Academic Regional 

07 = GED Program 

08 = Alternative High 

09 - Other 



29 30 



31 32 







33 


34 


I 





Did you last attend school on a 
full-time df^fr^rMime basis? 

01 » Full-time 

02 =ParWime 



Did you leave* school on your own 7 

b1 = Voluntarily 
02 k ~ Involuntarily 



35 36 



Did you last attend school during the 
day or night? 

01 = Day 
02= Night / 

° . r 

Why did you leave school? 

Proceed to question 45-46, Section V. 
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The following questions (37-38 thru 43-44) apply only X6 those respondents who were enrolled in school at the time 
they entered the CETA program (Question 17-18). • * / 



37 38 





39 


40 


I 


! 



43 44 



4» 



What wa,sthe name of the school you were attending? 



41 42 



What type of school were you attending? 



01 = Junior High 




02 - Cpmprehensive High ' 




03 - Private Trade High 




04 - Regional Vocational High 




05 = Academic Regional High 




06 = GED Program 




£7 = Alternative High 




08 = Other , M 




- * \ 




Were you attending school dupng the day Or night 7 



Were you attending school on a full-time or 
part-time basis? 

t)1 - Full-time 
02 = Part-time 



01 = Da^ 

02 = Night 



SECTION V: POST- PROGRAM EDUCATIONAL E'XPElTKENCES 



M5 46 



Whatwas the highest grade trtat you had 
completed at the time^ou left the 
CETA program? A 



. 47 48 



At any time during the* CETA program, did 

you receive preparation for a high school 

equivalency diploma (GED)? 
1 9 * 

01 - Yes (Proceed to question 51-52.) 

02 - No {If respondent had completed 

less than 1 2.years at time of 
leaving .program, proceed to 
question 53*54. If 12 years, t 
continue.) 



49 5fr 



Had you received a high school diploma 
by the time you left the program? 

01 - Yes {If yes, proceed to Section VI.) 

02 ■ No (If no, skip to questi&r\,53-54.) 



V 



51 52' 



■ « V 

Did you receive-a high school eqajvalency 
' diploma (GED) by the time you had completed 
the program or any time since you left the . 
program? 

01 - Yes (It yes. proceed to Section VI.) 

02 = Nb (If no, skip to question 53*54.) 



'5 



The following questions (53-54 thru 75-76) apply only to those respondents wbtohad not received a higt^school 
diploma at the time of termination from the CETA program OR had not received a high school equivalency diploma 
(GEO) at any time since leaving the program. (Questions 49-50, 51-52) 



53 


54 




55 


56 


(If yes) Are you currently attending school 7 
01 - Yes 






-Have you attended school at any time 
- since you left the CE^TA program? t , 










01 c Yes (If yes, continue ) 

02 = No {If no, skip to Section VI.) 






02 - No 

* 


57 


58 


How many weeks have (did) you attend(ed) 
school since leaving the CETA program 7 












What 


is the name of the school you are (were) attending' 


59 


60 




61 


62 








What type of school are (were) you 
attending? 






Were you refeired to this school by the CETA 
agency or did.you enroll on yo^u>own 7 



01 = Junior High 

02 3 Comprehensive High 

03 - Private Technical High 

04 = Regional Vocational High 
*05 ■= Academic Regional High 

06 = GED Program 

07 - Alternative High 

08 = Other 



01 * 
02; 



Referred by CETA agency 
Enrolled on own 



63 


64 




65 


66 






What is (was) your current (last) grade 7 

'''** . ■ 
















6? 


68 




69 


70 






Are (were) yo v t/attending school in 
the day or night? 







Are (were) you atte 
or part-time 7 ■ 

01 - Full-time 

02 = Part-time 



ng school full*time 



03 = Day 
02 = Night 



Is (was) this the same school you were in before 
you enrolled in the CETA program? 

01 = Yes , 

02 - No ' . 



Questions 71-72 thr.u. 7E>76 apply only to those respondents who are not currently attending school. (See 
question 55-56.) 



/ » 

71 *72 



r 

Did you coqnplete/grdduate from thje 
school you were enrolled in 7 * 



• 01 = res 
02 = No 



73 74 



(If yes) Did you receive a high school diploma 
or GED? 

01 = High school diploma 
.02 = GED ' x 
03 = Neither 



75 76 



(If no) Why did you leave school 7 



1 2 



I.D. Number 



86 - 



77 



SECTION VI: PRE -PROG RAM EMPLOYMENT HISTORY IN THE 
ONE-YEAR, PERIOD BEFORE CETA 



For interviewer's information: Date of program enrollment for termtnee: 



9 10 

ID 



13 14 



-Date one year prior to.programfcnroJIrrient: 
11 12 



18 



24 



Were voir employed at any time during 
the oroe-year period before entering the 
CETA program 7 

01 = Yes (If yes, continue.) - 

02 = No (If no, proceed to question 41-42.) 



How many totaJ weeks did you work during 
the year before entering CETA 7 - (00-52) 



21 



What was your final hourly 
wage on that jpb 7 



26 









29 


31 



How many weeks did you work at 
thatiob 7 (00-52) 



On whet date did you leave that job? 



(Mo./Day/Yr.) 



(Ifvyes) How many different jobs did you 
have 7 (Count each employee as a separate 
job.) 



15 



17 



22 23 







27 


28 






32 


33 



What. was your job title on the last job\ 
held in the year before the CEJA program? 

. iffir* " ' 



How many hours did you work per week on 
that job 7 • 

Did you continue woiAwg ^m thpt jQ h^rffjite 
enrolled in the.CETMsrogram 7 

01 - Yes (If yes, skip t§>question 34-35J 

02 = No (If no, continue ) J 



Why did you leave thatlob 7 



Proceed tQ question 41-42. 



The following questions (34-35 thru 39-40) apply to those respondents who answered yes to questipn 27-28. 



34 35 



39 40 



Did you leave that jobfcefore you 
left the CETA program 7 

01 ■ Yes » 
$2 - No ' * 



VVhy did you Jeave that job? 



36 



38 



(If yes) On what date did you leave 
that job? 

-(Mo./Day/Yr.) 



id. 



87* 



The following questions (4-1-42 thru 55-58) apply only to those respondei£s\wt>o worked LES$ THAN 52 WEEKS 
in the one-year period before entering the CETA program (question 13'Vl£j' 

% > ; 



41 


42 




I 


r 


45 


46 


• 











43 44 



, How many weeks were yqti not working 
during the one-year period pnor to 
enrolling in C£TA? 



How did you look forXvork? 
(two responses) 

01 = Public emploYment agency fDES) 

02 = Private employment agency 

03 = Applied directly to employee • 

04 - Placed or answered ads 

05 - Friends or relatives * 

06 = Other , 







49 50 







During the time when you were not working in 
the ote-year penod before entering CETA, 
did you actively look for a job? 

01 = Yfes(lf yes, continue.) 

02 - #o (If no, go to question 51-52 )\ 



How many weeka did you actively look . 
for work 7 



The following questions (51-52 thru 57-58) apply if the length off time out off work (question 41-42) ^greater than 
the length of time actively looking for work (question 49-50). As indicated above, this applies only to those who ^ 
have worked less than 52 weeks in the one : year period prior to enrollment. 



51 52 



53 54 



55 56 



During the time when you were not 
looking for work, did you want a job 7 

01 = Yes 

02 = No " 

- >! , 

r 

-During the time when you were not 
looking for work, what were-the primary 
reasons you did not look! (two responses) 



During tfce tune wtien-you were not looking 
for work*; were you available for work? 

01 = Yes 

02 = No 



57 58* 



) 



FOR ALL RESPONDENTS" 
59 60 . 



61 62 



-63 



67 



What was yoOr tefl ^ed income (not family, income) 
before.'ta*es in thel|BefjBre entering the CETA program'', 



88 



73 



•SECTION VII: PUBLIC ASSISTANCE STATUS 



68" 69 



74 75 



Other than yourself, was anyone in 
your family?receivmg public assistance 
or unemployment compensation during 
the one-year peripd prior tb enrolling 
in CETA> 

01 = Yes „ , 

02 = No 



Were /ot/ receivinc^pabhc assistance or 
unemployment compensation during 
the one»year period prior to.enrolhng 
in CETA> 

01 = Yes ^ 
• 02 = No 



70 


71 






72 


73 




j 


76 


77* 


> 


k — 


78 


79 






# - 



(If yes) What type(s)? 
01 - AFDC 
"0?*" F^TOStamps j 

03 = Unemployment 

insurance 

04 = General relief 
0§ - Veterans f 



06 ^Medicaid 

07 = Social Security 

08 = Supplemental 

Security 
Income (SSI) 

09 = Other 



(If yes) What type(s)? 



01 


- AFDC 


06 = 


Medicaid 


02 


= Food Stamps 


• 07 = 


Social Security 


• 03 


- Unemployment 


,<*■ 


Supplemental 




insurance 


Security 


04 


- General relief 

- vwerans 




Income (SSI) 


05 


09- 


Other v 



0 


8 






2k 











10 



15 16 



I D Number 

! 



Other than yourself t is anyone in your J 
famrly currently receiving public 
assistance or unemployment compensation? 

01 = Yes 

02 - No 



/ 



Are you currently receiving public 
assistance payments or unemployment 
compensation* % 

01 = Yes 

02 = No 



r 



11 12 







13 14 







17 18 







19 20 







(If yes) What typelsP 






01 


-AFDC 


06 - 


Medicaid 


02 


= Rood Stamps 


07 = 


Social Security 


03 


~ Unemployment 


08 


Supplemental 




insurance 




Security 


04 


- General relief 




Income (S&D 


05 


= Veterans 


09- 


Other 


(If yes) What tyfJels)^ 






01 


= AFDC" / / 


06 = 


Medicaid 


02 


= Food Stsffpr' 


07- 


Social Security 


Q3 


- Unemployment 


08 = 


Supplemental 


insurance 




Security 


04 


= General relief 




Income (SSI) 


•05 




09 = 


Other 



SECTION VIII: RESPONDENT'S PROGRAM EXPERIENCES 

Only one part (A through D) of questions 21-22 thru' 55 56 applies to each respondent/The applicable seot.pn is 
dependent upon the°program category from whicn* the respondent terminated: . „ 

_^Part a - 0 For respondent/who terminated from a classroom/skill training program 
I Part B - For respondent who terminated from a work experience program 

Part C - For respondent who terminated from an on-the-job training (OJT) program 
, ' Part D - For respondent who terminajecMro/n a transitional service program m 



r 



PART A* CLASSROOM/SKILL TRAINING 
Part A is applicable only to thQse respondents who 

21 22 



terminated from a predominantly skill training program. *• 
23 * 25 



26 27 



During your participation in the sktJI training 
program, what were you being trained to do 7 

_ . ' (Census Code) 



28 



31 



Was this an area in which you were 
interested in beifig trained 7 

01*= Yes 
02= No 



What was your weekly wage in the 
training program 7 





32 


33 




34 


35 












How many hpurs per week dioSyou 
receive skill training 7 






Do you*feerthat you received a sufficient amount 
of instruction in the CETA„p(ogram? 


1 






• 






* 01 = Yes 
, 02 = No 

c 




36 


37 


* 


38 


39 




• 




• . i 


Drd you receive academjc credit for 

your participation in the training * 






in aaaition to receiving training a* a 
iquestion 23-25), were you provided with any 








program 7 , 






additional types of classroom instruction 7 








• 01 = Yes 

• 02 r No 






01 = Yes 

02 - No 




40 1 


41 




44 


45 












(If yes) What types 7 (two responses) 






Did you complete the program' 








01 = ABE 
% 02 ' GBD 
^03 = ESL 






01 = Yes 


•> 










02 = No 








'^04 = Transition services 
05 = Other . N 










* 


46 


0 

47 




48 


49 




> 








(ifno) Why did you leave the program 7 ^ 








At 

i 




















50 


51 


f- 

* # 


52 




54 


On */hat date did you leave this program? 

* t\ 


m 


















e * 








(Mo./Day/Yr.) ^ * 




55 


5* 






1 






\ 


















* 


4 " ** 











P/JRT B^WORK EXPERIENCE m 

Part B$s applicable only to those respondents who.termjnated from a predominantly work experience prog 



21 22 



23 



25 



What was your job title while you were 
enrolled in CETA2 *' * ' 

Tc ensus Code) 



r % 



7 



"90 



ERIC 



Si 



-1 



« 



• . Y 

.--v.. 



26 27 



A 





1 


32' 


* 33 






36 








i 




40 


41 


1 

f 


I 
I 






44 


45 






46 


47 






► 

50 


51 






♦ 




55 


56 




h 


y 

* v 



How many hours did you work * 
" per week' v * * 



.Did ypu.work as pact ol a work crew, 
with other persons your^gd or 
yourself under adutt supervision? 

01= Work clew % j 9 

02 - By yourself with adult sjrervision 

*. . ' \ . 

Do you feel that you' received a\utj[icieTTt 
* amount oj supervision while in tme * 
*CETA program' : 

*> 1 

01 - ¥*> ? . 

02 = No 



28 



34 35 



38 ; 29 



V 



43 



Did you receive academic credit for 

your work 7 X 

01 - Yes • , \ 

02- No ' \ 

(If yes) VVhat types' % , , " ' 

01 - ABE , % \ 

02 = GEO , V 

03 = ESL 

04 - Other . , , 



48 49 



31 



hat was your hourly wage^ate' 



(If respondent was pan of a work crew} 
What was thewtal number of CETA youth 
workers in thfe crew 7 



( 



Do you feel thai the supervision you received 
^was sufficient to be able to dGsft^ood job? 

01 = Yes , * 

02.= No • ' ' 



Other than working as a - — ^ 

{question 23-25), did you receive any form 
of classroom irainfhg while in the program' 

0l' = Yes* • < If' 

02 - No 



Did you complete the program' 



01 - Yes: 

02 - No 



52 



54 



(If no) Why did you leave the program' 



On % what date did you leave the CETA 
program' * % 



(Mo /Oay/Yr ) 



(If respondent completed the program, question 48-49)' 

9 * « 

Are* you currently employed in this job' 4 

01*= Yes , • ~ 

02 = No ' v 



PART C ON-THE-JOB TRAINING 

Part C is applicable only to those respondents who termioj&ed from a predominantly on-thejxxbttJrrm-fOJ?t 
program. , » \ *, % 

, * ' ^23 *25 

White particip3tin9»if\ypiir on-the-job 



22 



training program, werd you .being trained 
for a specific .type of job? 



(If yes) What was the specififcjob you 
-were beim£train£d-lop? ^ — : — - 



.(Census Code) 




^6 27 



i~J -How many hours did you work 
H .per week?* , % 



Oo*you feej you received sufficient 
training on j£e job? 

01 -'Yes 

02 = No 



28 



What was your hourly wage rate? 



34 36 



Qo you feel tri&t, the supervision you received v 
was sufficient to be able to do a good job? 



01 ~ Yes 

02 = No 



36 -37 



38 39 



40 41 



On your particular worksite, was there 
a*group oWCETA workers or were" you 
the only one 7 , . 

01 ■ Group 

02 = Self ' 



□ 



46 47 



you receive any form of 
classroom training 7 ^ 

01 = Yes 

02 -No * 



Did you complete the program? 

01 = Yes 

02 = No 



42 43 



XL 



I 










48 


,49- 



Did you receive academic credit for your 

work? > 
# 

01 = Yes 

02 = No' 



(If yes) Wbat types? 

01 - ABE 

02 - GEO 

03 = ESL 

0£.~ Skill training 

05 J Other \. 



(If yes) Are you currently employed ife 
this job? 

01"- Ye<r • 
02 = No < 



* 50 51 



(If respondent did not complete program) 
Why did you leave the'program? 



55^ 56* 



52 



54 



On what date did you reave the C ETA 
program,? 
* « 

- >' ' (Mo./Day/Yr.) 



" x 1 PART & TRANSITIONAL SERVICES - 

(' "Part 0 15 applicable only to those respondents who terminated from predominantly transitional service programs. 

• - t ■• • * . . r t * • J 

Did you receive counseling construction irr^ny or~tfie rdUbwlng^pec///c areas.? . . == "v " «-~ 



7 



2"N 22 



23 25 



Occupational /Career Counseling? 

01*Yew ( -' v 

62 = No ' +0*S 



\ . 



tERJC, 



8& 



92 




- N V 



26 27 



32 33 



36 37 



40 41 



44 45 



( I f yes) How woUld you rate this 
aspect of the program? 

01 ■ Excellent 

02 - Good 
03v Pair 
04 = Poor 



Counseling regarding work habrts 7 

01 = Yes' • 

02 = No . .a 



Resume preparation/compje^d'n of 
' job applications 7 ° 

01= Yes ^* , 

02 = No - 



Job interviewing techniques 7 

01 - Yes & 
02= No 



Job finding techniques 7 

01 = Yes 
02= No 



48 49 



Dip* you complete the program 7 



. 01 - Yes 
02 f No 



52 



54 



On what date did you leave the 
, CETA program 7 j 



{Mo./Day/Yr 





28 


+1 




V 






4 


34 


* 

35 


* 4 


















<. 


38 


"39 












& . 








42 


43 








s 

f • ° 








46 


47 










50 


51 










55' 56 



31 



(If yes) How would you rate this aspect 
,of the program 7 * 

01 = Excellent 

02 = Good 

03 = Fair 

04 = P6or 



I 



m 



{If yes) How would you rpte this aspect 
of the program 7 » 

01 * Excellent „ 

02 : Good 

03 = Fair 

04 = Poor 



{If yes) How would you rate this aspect" 
of the program 7 # 

OT = Excellent * 

02 = Good 

03 - Fair 

04 = Poor 



(tf.yes) How would you rate this aspect 
of'the program 7 " * 

01 = Excellent 
02'\Good 

03 = Fair « y 

♦ ^04 = Poor 



r 



01 no)j Why did you leave the program 7 



SECTION, IX: TRANSJTIONAL/SUPPORTIVE^ERVICES 4 ■ * . 

PARJ A. Transitional seryices r questions 57-58 thru 65-66, v apply to alf respondents with the exception of those 
• ^terminating from pfedominantly^ transitional services' programs. • ' C - " ^ 

While in the CETA program, did you receive any of the following services 7 . . . ' 

•57 58 ^ . * / 59 60 



□ 



OccUpatipnaf/career counseling?' 

01 J Yes % 
< 02*{|o 



\ 



Counseling regardihg work habits? 
f 

OT * Yes , • # ' 
02 - No 



61 62 



I 




65 .66 







Counseling regarding resume preparation/ 
completion of job applications? 

01 = Yes 

02 = Ho 



Counseling regarding job finding techniques 7 



63 64' 



Counseling regarding job interviewing 
techniques? 

01 = Yes 

02 =.No 



01 - Yes 
^02 = No 




6PORTIVE SERVICES - For all respondents 

While in the CETA program, dfd you receive* ?ny of the following services 7 . . . 



91 


68 






7U 


f 

72 







69 70 



Health care? tt 

01 s Yes 

02 « No * 



Transportation* 

01 « ?es 

02 = No 







73 


• 

^74 







Child/day care 7 

01 = Yes 
02- No 



Personal counseling 7 

01 Yes 

02 No 

K 



3* % 



8 ± 

I.D. hfumber 



Are yt>M cutrently receiving any of the following services 7 

I 



9 


10 


I 


M 


$ 

\i 


14 







• Pteaith care? 

01^ Yes * « 
£2 »fio 



Transgor t a t iSnT^ 

,0>= Yes 
02* No . * 



SECTION 



X: ; RESPONDENTS f I E^. 



-5 


* 


** . 

15 9 16 







\ Child pare' 

.01^ Y« 
02 = N(K-/ 



Personal counseling? 

•.01 - Y*. ^ 

' 02"-jNo ' 



IOF PtfOGRAM 

19'20 







21* 22 







Howdic^ou hearjaboutthe CETA/ 
imr 



program? 



Do you ieel that your fJarticfpation in * 
> CETA has improved your chances of ( 
finding and keeping a iop 7 ^^* * 

OH ■ Yes • : • 







23 


24, 




. 1 



Why d'd^you enroll in the CETA program 7 




25 26 



participatrbn, do 



Because of your CETA particFpci 
you think you hav o (had) ab e tte r c ha n c e 
of returning to or staying in school 7 

01 * Yes 

02 » No 



27 28 



Do you feel you had sufficient access to services 
si/ch as personal counseling ana career 
counseling? . • 

01 = Yes 

02 = No 



ft 



29 30 



33 34 



31 32 



37' 38 



HE 



(Jf no) Whicji particular services were 
not sufficient 7 (two responses) 

01 * Personal counseling 

02 3 Career counseling 



Would you recommend the program * 
to others 7 * ■ 

01 = Yes ' 

02 = No m 







35 


36 






39 40 







What were the best tw 
program 7 



ngs about the 



How would you improve the program? 



SECTION XI: SUMMARY PO^ST-CETA INFORMATION 



41 


42 






45 


46 








* 

♦ 


49. 


50 







How many jobs have you held since'leawng 
the CETA program? |lf none*, proceed?? 
Section XVII.) 



43 44 



Affile time youfef t youV CETA p 
nn (insert date of 



program 
termina* * 



. 01 - Yes (If yes; proceed) 
02 =fjo'(lf no, skip' to question 64-54) * 



'Was there a gap between the time you 
finished actively pprtiapatin§ irt your CETA* 
program and the time you obtained that job? 
> * * 

01 = Yes (Jf yes, proceed) * 

. 02 = No (If no/code question 51-62 as 2ero 
>^ _ and proceed to question 67-69 P page 16.)^ 







\ 

47 -a 










-51 5*2 







Are you currently employed 7 ' 



01 * Yes 

02 - Nof* 



■ „ 
Did you find your own fob or did the CETA 

agency find it for you 7 v - 

01 = Found own job 

02 - CETA' agency found job 




How many wtleKs after you finishedhjctrvely * 
participating in your^CETA program did it 
take to obtain thatjbb? 

Proceed to question.67-69, page 16. % 

* r \ 



tuestion 6 



SECTION XII: RESPONDENTS FftRST JOS /frTER CETA ■ , 

' % J___For t hose responde nts vvAo, have Jieliat Leasuwe^Sb^hei CETA 



Questions 53*54 thru 65-66 apply only to those resfaoi&nts who rJid not have a job at the time they .left Iheir* 
CET*A program (question 45-46,«above). ' i ' 

* J* 



^53 54 



55 56 



'*How many weeks after leavtag the CETA 
program did it take to obtain your first job? 



Di<J you actively look for the entire 

week period 7 (See previous question,) 

01 ■ (If y^s,-jkip to question 67-6fi,*page . 

02 -No (If no, tontinue..) : 

/ 



v 
r 



95 



) 8G 



57 58 V 
During the time when^ou were not lodkmg 
for work, did you want ajob 7 



59 60 



61 62 



$3 64 



01 ^Ye> 

02 = tyo 



What were the primary re'Ssons you did 
s not look for a job during that time 7 
(two responses) 



FOR ALL RESPONDENTS (who have at least one job) 
' 67 69, 







65 


66 







On what date did you begin your* first job after the CETA 

program 7 — „ 

(fyio./Day/Yr.) 
(Code date of termination if job ts same asiob held 
wltfle »n program.) 



» Wpfe^pu available for work during that time?- 

01 = Yes 

02 = No 



Aow did you find your first job afte> leaving 
the CETA program? * , •* 

01 = CETA agency . ^ 

% 02-=DES : 

03 = Privaje agency 

04 = "Friend** 

05 = Newspaper 

06 ■ Walk-in 

07 = School 

08 = Other a 



Company Name 



Business Address 



No. & Street 



What does your company do? > 



City 



^ State? 



70 



2«P 
72 



1 


0 

















I, D. 'Number 



~Que^tTons~9-11 thru 24-25 refer td the respoMenx's&tartrng job position with the company named above,. 



What was ysur starting job title? 




What'was yourstartmg wage 
per hour? (Include bonuses, 
tips, gommissions) 



11 



Censuv 
Code ^ 



16 17 



How many hours did you work per Week? 




***** * 



'18 t9 



Would you have preferred to work 

01 = More : 

02 55 Less 

03 = The same . 
. . . amount of hours? 



20 21 



After being employed for one week, did you 
receive any training at work from your 



employer 7 

01 - Yes 
02= No 



22* 


23 






24 


25 




J After being" hired, how many weeks did 








I it fake before you could perform your 








duties on your own 7 

» 






26 


28 


, '"■ Aj 


29 


30 








What was your new job tfcle 7 




0 



(Census Code) 



While working for this employer, did you 
have a change in jobs 7 

01 = Yes (If yes, continue.) 

02 - No'llf no, skip to question 31-32.) 

Was the new job a promofcon? 

01 = Yes 

02 = No 



r 



FOR ALL RESPONDENTS (who had at least one job): 



31 32 



33 



36 



Did you receive any change in your 
houFly wage rate 7 

01 - Yfs 

02 - No ? 



(if yes) What was your final 
hourly wage 7 



(If no, write in same hourly wage 
f* as in question 12-15.) 

> ■ . . ' y- 

Only one Part (A through D) of questions 37-38 thru 43-44 applies to each respondent The^applicable section is 
dependent upon'the major program category from which the respondent terminated: 

p art a •— * For respondent who terminated from a classroom /skill training program 
Part B - For respondent who terrwnated from a work experience program 
PartC - Foi' respondent who terminated from an O^rpVogram > { u 
Part D - For respondent who terminated frorrua transitional serw^es.prograrn 



PART A 

37 38 





* 




41' 42 




I 



For Classroom/Skill Training Participants Only 



Did the CETA training influence your 
decision t& look for^thisfcind of job? 

01 = Yes ' . ■ 
" 02^Nb~ — — 

How many hours did you work 
perday? hours 9 

Of these hours, howvfnany hours 

per day did you us& your feETA' trainings 

*[ Express in terms of an 8-hour day — use 
conversion chart*ifnecessary) 



39 40 



43- 4^ 



Was this position's!work related to your 
GET A training 7 

01 = Yes ' 
•02 = N9 . 



Do you think you could have obtained ' 
this job without 'the training services {not 
the placemen tj provided by tfce C£TA program? 

01 = tes 4 ' 

02 = No , 





9 

ERIC 
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, -n; . 8 

- -r 



ft 



r ART B 



For Work Experience Participants Only 



• 37 



38* * \ 

, Did your CETA participation provide you 
— wi t h a good untietsia ndmg of what was 



expected of you on the job? (i.e., tardiness, 

• absenteeism, ather work habits) ^ 

Qt = Yes 

• 02 = No 



' 39 40 



Old yo ur CETA^partictpation im pjoye your 
ability to complete the tasks on your job 7 ^ 



01 = Yes 
02= No 



41. 42 



Do you think you could have obtained 
this job without the work experience {not 
the placement) provided by CETA 7 

. 01 = Yes 
02 = No 



43 44 



PART C - For OJT ParticipantsOnly 

37 38 



41 42 



Is (was) this job . . . 

01 - The samelob you were Ubmedfn 

(same employer and job as you 
were trained irv) 

02 = A different job than the.one you 

were trained in (different employer 
or different joOj 



erejit 



39 40 



How many hours did you work per 
day 7 1 hours 



.hours, how many hours 



Of^hese 

per day did you use your CETA training? 

(Express irf terms of an 8-hour day; use 
conversion chart necessary.) 



43 44 



(If different job): Did the CETA training 
influence your decision to obtain this kind 
of job 7 

01 = Yes 

02 ^ Klo A 



Do you think you could have obtained 
this j3b without the training { n 6t the 
placement) provided by the CETA program 7 

51 = Yes 

02 - No * 



PA&T D - For Transition Services Participants: 



37 38 



Tjl Did tfre services you received provide you 

•j* ' A 



-41 ^42 



with a+goo3 understanding of what was 
expected of you on this jpbr* (i.e., tardiness, 
absenteeism, other wofk habits) 



01 = Yes. * 
02= No 



. Did the CETA program influence 
decision ^o otftain this type of job? 

01 - Yes. ■ i 



i you^x 



39 40 



43 44 



Did the services you received improve'your 
• ability to perform the tasks on your job? 

01 = Yes 

02=,No ' v 



FOR ALL TERMINER (who had at least one job): 



45 46. 



* 47 %48. 



• 


\ 


All things considered, how would you 
" rate this job (type of work)? 


K ' 








• , • 

* 01 * Excellent 
02 = Good 
_ ,03-= Fair 
04 = Poor 








49 5Cf 


o "i • 

r 


51 


52 




i 


"View many weeks did you work at 
s this job? t , 







53 54 



All things consWered, how would you rate 
this employer 7 # ^ 

01 = Excellent ^ . 

02 = Good 

03 = Fair 

04 =*Poor 



Are you currently employed in this job 7 

01 - Yes Uf yes, go to^ Section XVIII ) 

02 = No (If no, continue to appropriate 

jot? section or Section XVII if only, 
had one job,)' 



Wr\y did you leave this job 7 



End of Section XII - 
Respondent's First Job After CETA 



The follpwing three sections are applicable only for respondents who have held THREE OR MORE jobs after , 
leaving the CETA program. Sections XIII, XW, and. XV apply to those jobs held between the FIRST job after 
CE*A and the CURRENT/LAST pb after CETA. INFORMATION ON THE CURRENT/LAST JOB MUST NOT 
BE ENTERED HERE. For respondents who have tftHd only two jobs since termination, proceed to Section XVI - 
■ "Respondent's Current or Last Job". v * 

.SECTIOINfXIII: RESPONDENT'S SECOND.JOB AFTER CETA 

, For respondents who have held at feast threje jobs after they left CETA 

55 56 



> were y 

7 this jo 



61 



After your first job, hdwmany weeks 
were you oijk\ of work before finding 

b» * * * '•" i ' -..IS? 



What.was your final job title on 
*| -thislob?- ^ 

, (Census Code) 



64 



67 



$ 



HE 



What was your final 
hourly wage? ' 



70 71 



Why did You leave this job? 



'Of. . 

















s 


2 




3> 






,8 


I 


1. 


1 














9 


I.D. Number 



57 


58 


> 






puring this time, did you actively look 
for work 7 * 






01 - Yes * s 
"02 - No 


62 


63 


How many hours di# you work per Week? 






* 

68 


69 


How'many weeks did you wodk on 
this job? k ' 
















• 



* - ( 



Ml *>> . 



99 



; DO- 



... . ■ ?' 



m SECTION XIV: RESPONDENT'S THIRD JOB AFTER CEJA_ 



For respondents' who have held AT LEAST F0VR JOBS after they left CETA. 



9 10 

□3. 



After your second job, how many weeks were 
ypu out of work before finding this job? 



13 15 



What was your final job title 7 
(Census (^ode) 



18 



$ 



2\ 



What was your final hourly 
wage? - * 



24 25 



Why did you leave thts job? 



11 12 | 

During this time. cftd you actively look . • 
for work? 



16 17 



22 23 



01_= Yes 
02 No - 



How many hours did you work per week 7 ^ 



How many weeks did you work on this 
job? 

\ 



> 



SECTION XV: RESPONDENT'S FOU&TH JOB AFTER CETA 

For respondents who have held AT LE ASM FIVE JOBS after they left CETA. 



, 26 27 j& ' c 

After your third job. how many weeks 
were you out of work before finding 
this job 7 



28 . 29 



30 ,32 



What was your final job title 7 

— * ' ' (Census, Code) 



35 - 38 

What was your final hourly wage 7 







33 34 






39 40 







during this time, did you actively look 
for'work? 

01 = Yes 

02 - No 



Howsnany hours did you work per we^k 7 

• ' . ■ $ 

How many weeks did you work on this 
job 7 * % 



41 42 



Why did you leave this jot^ 



( 

SECTION XVI: RESPONDENT'S CURRENT OR LAST. JOB 



43 44 



For all respondents who have held A T LEAST TWO JOBS after they left CETA. 

4& 46 



How many weeks were you out of work 
before obtaining y<jur current/last jot}?, 



| ^| Oid*yOu activelylook for work for the entire 



week period? (See previous question.) 

01 45 Yes (If yes, skip to question 55-57.) 

02 ^No (If no, continue.) 



V - 



too 



9l 



47 48 



49 50 







51 


.52 


I 


•I 



Dunng'the lime when you were not 
Rooking for work, did you wanra iob? 



02* No 



5 



What was the pnrfiary reason you did 
not look for work during that time? % 

A. 







53 


54 







Were you available for work oaring that 
J lime 7 / • 

P1 « Yes 
02 = No 



How did you f m<i yourcurrent/last job? 
01 - CETA agency ,05 * Newspaper 
02- 5eS « 06 = Walk-in 

03 = private agency , 07 = School 



Q£ = friend 



08 - Other 



Company Name' 

Business Address* 

What doeS your 
company do? 



No.& Street 




Questions 58-60 to 71-72 refer to the respondent's starting job position with the company named above. 
What was your starting job title? i * < 



58 



60 



v- 



Census Code 



61 



64 > 

What was your starting wage 
per tiouP? ( Include bonuses.- 
.lips, commissions.) • 



65 6fr 



How many hotirs did you work 
perweek?^ 



Would you have preferred to work . . . 

~ 01 = More 
02 Lo s s ; — t. - 



69 70 



.71. 72 



03 = The same 

. . . amount of hours 7 

4 

' After being hired, how'many wedks did 
- it take before you could perform your,- 
job duties on your own? , ' * 



73 74 



75- 



77 



Wharwds your new job title? 

4 m (CensMsCocW 



IB 79 

LB 



wo^^rdr 



/eek,didyou , 
irrvyour 



After-beiny employed f 
receive any training at w 
employer 7 

"01 ^fes ^ 
02= No ^ 
\ 



While working for this employer, did you 
have a change in jobs? • . 

01=- Yes (If yes. continue.) 

02 = No (If no, skip to'question 9-10.) 



Was the new job a promotion? t 

01 =Y«s / *' - 

02= No " * 



I.D. Numbe 



FOR ALL RESPONDENTS (who had auletst two jobs): 

e* jo 

Didtvou receive nnv chanap in vnnr 

$ 



Didtyoureceive any change in your 
hourly wage rate 7 



11 



01 - Yes 
62**No 



14 



Of yes) What wgs your final 
hourly wage? 

(If no. write in same hourly wage as in 
61-64.) 



-Offo one Rar t (A th resh D) of questions 15-16 thru 21 22 applies to-each respondent. The applicable section is 
dependent upon the program category from which the respondent terminated: 

• Part A* - For respondent who terminated from a ofassroom /skill training program. ' 
„ Part B - For respondent who terminated from a work experience program, 
0 r « - PartC - For respondent who. terminated from an OJT program « J 

, ^ Part C 'f^or.respondent who terminated /rom d transitional services prograrj^. , - 



PART A - For Classroom/Skill Training Respondent 



15 16 



17 : 18 



19 «20 



1 Did the CETA training influence your 
J decision to look for this kind of job ?> 

01^ Yes* . - 

02 * No * ' 

j How many hours did you work per day? 
hciUXA. . 



Of these . 



.hours, how many hours per 



noun 

day did you use your CETA training? 
(Express in terms of an 8-n^|ur day. use 
conversion chart if necessary.) 



* 






\ 


21 *22 




r 1 



f 



Was this position's work related to your' 
CETA training? * v 

01 ^ Yes ♦* '. r ■ 

02iNo • 



Do you think you*could have obtained this 
jobVvithout the training services (nofthe 
placement) provided by the* CETA program? 



01 • 
02' 



Yes 
No 



3: 



PARTJ* For Work Experience Respondent 

15 16 1' V . : * " 

Did your CETA^participation provide you with 
a good understanding of what was expected 
of^you on the job? (i.e., tardiness, absenteeism, 
general' work habits) 

01 • Yes v 
02=^d 4 



Al 18 



Did your CETA participation improve your 
ability to complete the tasks on youc job? 

01 * yes - • 
02.= No 



19k 20 



Do you think you could have obtained 
thi?J9& without the work experience 
[not thp^lacement) provMed by CETA 7 

01 - Yes 

02 - No 



21 22 



PART C - For OJT Respondent 



15 16 



19 20 



Is (was) this job . . . 

01 - The same job you were tra"ined-m^ 

(same employer and job as you y 
were trained in) „ / 

02 = A different job than the one you j 

were trained m 7 (differenbemplbyer 
t or different job) \ 

How many hours d?H you wofk per day? 
hou rs — _ 

Of these hours, how many hours 

perday did you use your CETA training 7 
(E^PRss in terms ofan 8-hour day. use 0 
conversion chart if necessary,) 



:J7 18 



21 22 



(If different job) Did the CETA tracing 
influence your decision to obtairi* this kind 
of job 7 " " / t 

01 ~- Yes o ? 

02- No * . 



Do yog^ihink you co^ild have obtained this 
**job without the training {not the placental) — 
provided by the CETA program 7 ' ♦ 

01 Yes 
02- No 



PART D — For Transition Services Respondent 



,15 16 



19 20, 



rDid. the services you rece'ved provide you , 
with a good understanding of what was ^ 
expected of you on this jpb 7 (i.e., tardiness, 
absenteeism, other work habitsf 

01 = Yes 

02 * No. " ^ 



Did the CE-TA prograrr>influence your 
- rjar^nn tn nhtam this type ofrob? . t 



01 - Yes 
0? • No 



17 IE 



21 ^22 



Did the sarVices* you received improve your 
ability to perform the tasks on your job 7 

01 = Yes' 

02=^No * 



FOR ALL RESPONDENTS (who have had a/ least two jobs): K • 

23 -24 • ' . ' ' / / \ 26 I 

P 1 All things-considered, how would you .« / J 

rate this job (type of work) 7 j % I ■ I 
' 01 ^'Excellent y . * 



02 * Good 

03 38 Fatr 
04. - Poor 



AH things copsidered, how would y,ou 
rate this employer? 

01 * Excellent • 

02 = Good 
08 ~ Fair*^ 
04 * Poor 



103 ' 



9^ 



27 **28 







31 -32 


r 


0 



How many weeks dicJ you work at ~ 
this job? 4 * - 



Why 'did you'leave this job' 



29 30 



Are you currently employedjn this 

01 * Yes (If- yes, skip to question 49-50.) 
/02-- No (If no, continue.) , c* 



S^CTION'XVII: FOR RESPONDENTS WHO /r% NOY CURRENTLY EMPLOYED 

"' fployed£\h\s sectio^us/jof applicable^ Proceed 



33 34 







* 

37 38 






41 42 







(If respondent is currently'er 
to Section XVI 1 1 , below.) 



How many weeks have you been out of 
^work since your last job {or since leaving 
the program) 7 0 - 



For how many weeks have you actively 
looked for work 7 



Are you currently looking for ajob 7 

01 = Yes {If yes, continue.) 

02 = No (If no, proceed to question 45-48.) 



45 46 



V- 


1 


47 


48 







< 35 


36 






39 


40 






43 


44 







\ 

X 



What are the reasons you are no't currently" i 
looki^fl 7 . 



Have you actively looked for«work smce 
,our last job (or the CETA program) 7 

0\ . Yji • . 
02* No 

/ 

Are you currently available for vCorlc 7 

01 - Yes , y — 

02 - No *~ 0 r 



(If yes) How arej^u looking for a joli? 
ning agency 



01 = Trai 
02- DES 

03 = Pnvate^gency 

04 = Friend 

05 - Newspaper 

06 = Walk-in 

07 = School 

08 = Other 



SECTION XVllk> RESPONDENT'S OTHER POST;PROGRAM EXPERIENCES 

'* (For alf respondentsF 



49 50 



Since leaving the CETA program, have you attended 
a postsecondary school/training program/CETA pwgram 
or enlisted in the military? 

01 * Yes (If yes, continue.) t 
-02 i No Of no^end of interview. Remainder of questionnaire 

should be coded ''; not a^plyiable.) ^ ^ 



M yrs. whu li om'(s) , 
SI ST 



|, | J Schy)l/train»ng program/CETA program 7 



1 



01 = School/training program 

02 = CETA program 



















\ 












* 






Military 7 












01 = Yes 




* * 



Are you currently . . . 
55 56 



57 58 



I Attending school/training program/ 
I CETAprog^dm 7 * £ 



»01 = Yes'' 
02^ tfb 



02- No 



Serving in military' 7 

01 = Yes 

02 = No 



7 ' 



1 


2W 


• 3 » ' ' 




8 




1 


3 




', i .3 ' - 








I.D. Number 








J 









SECTION. XIX: FOR RESPONDENTS WHO HAVfefJARTICIPATED IN 
. ' N ANOTHER SCHOOL/TRAINING PROGRAM /CETA PROGRAM ' 

Sl!<ICE LEAVING CETA (question 51-62 above) # 



/ 

9 •1C. . ' f 

Whajt type of/school/program, are* (were)' 
you enrolled \V Je,s.. welding, clerical. 



"7*~ 




14 15 






19 20 


i- 





11 



business matrt;Svprk~experjencef ' 



13 



* How m'a/W. weeks -after the CETA program 



» .j I 1 How many weeks have (did) you ^ 
I ' I J attend^) 7 i 









16 




/*» 
18 


/ 












21 


22 





What agency is (was) providing the 
schooling/program 7 t c v 



I tfUS | 



J 



' V ^SMo./pay/Yr.) 



01 = v, FuH*time 



2g ,25 



-2 6 - 2 ?- 



-^Ns*— ^ 



How many'weeks is (was) the 
Complete program 7 



28 29 



L 


1 


\, » 




-32- 


•33 







Why did you enroll in this program? 



-ikifr 

c 

' Is (was) yfiyrjarior CETAparticipatian 
helpfuttc^Jou in' this program? * 

01 ^Yes^ • ^ « 

• 02 * No ' 



Hgwe^you completed the program 7 

01 = Yes % *\ 

02 = No 



SO 31 fp, . .V- 

iV(was) this schooling/program related to 
your pr»or*CETA participation? . 

01 - Ye's s 

02 = fao ' * 



-f, — 




'■105, 



: ■ < 

1 • no 

• DO 



SECTION XX: FOR RESPONDENTS WHO NAVE ENLISTED ifsl THE MILITARY 
• nSINCE LEAVING CETA (question 53-54) — — 



34 35 



t Why did you join the military? 

01 - to receive training 

02 - Career cfooice * 
"03T = No better opportunities/ f 

alternative's available . ■ 
04 - Other lJ__1 



36 37 ' 



Is (was) the military work. related to 
CETA participation? V 

01 " Yes 

02 - No 



38 



40 



i *On what date did you enter the military? 



(Mo /Day/Yr.) 



* 



t 
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APPENDIX B 

HOW TO INCREASE CONFIDENCE 
, IN DATA COLLECTED 
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i 



HOW TO INCREASE CONFIDENCE*! N^DATA 



COLLECTED BY 



MAJLED QUESTIONNAIRES 



The issue of data confidence is.extrem?ly important in any data-collection [nethod, and in 
research methodology it involves the question of measurement error. A self-respecting evaluator 
makes a primary effort to ccfatrol measurement error jn order to increase the "truthfulpess" 
(reliability and validity) of-thje dat^ being collected. In an effort to lessen measurement error, the * 
following strategies are discussed rn this chap^er.'(l) determining how many items there should be 
per dimension, (2) determining what questipi|s to ask, (3) determining appropriate wording of the 
' f guestions^nd (j) determining appropriate repdhse options. 



Determihing Hovy Many Items per* Dimension] 

An exam i nation; of follow-up irytrumentjs used by state and local vocational education agencies 
shows that information on training &tisfacticfo and job satist&ction is either collected as unidimeW 
sional variables (i.e., one global question) pr as multidimensional variables (I.e., several questions)/ 
The question, therefore, is haw ; many items per dimension?. ' • 

It is generally best ta include more tharj one item thatfis intended to measure a given construct, 
iarticularl9,when that construct is central to the study, th&e are several reasons for this decision. 
Any,onfc 4 item Includes some measuremeht.efror, that is,, some 3f-the variaffce in the r^ponses across » 
subjects is dire. to error rather , than true score. If the Squrces erf this e'rr6r can be considered to be 
random factors (such as how wording is interpreted or how the scale's anchors are defined), then 
using multiple items will increase the construct validity of the score. This is true because the random 
errors tend to cancel each other, while thertrue score" components will add up. Accordingly, it is 
ofteti asserted that the reliability of "a scale generally increases as items are added (assuming that 
they are dood items). \ ] ' | 

J 3 * • 

Another reason for using multiple it/ems is to allow for examination of the convergence amohg 
items. If two items are supposed to be measuring the same' thing, then they should correlate to a 
reasonable degree. The'exact number that is* "reasonable" depends upon whether you are criticizing 
'someone else's instrument or trying to validate one you have treated. 

When new items are being created to measure a construct, it is best to indude at least three 
per construct. Even very similar item^can occasionally lack convergence. If three items are used, 
chances are'good" that two will proveAo be gawt&ems^and converge at a satisfactory level. (Pretest- 
ing the instrument to determine convergence'andlfcequTring as*eworking pt items are good ideas, 
of cobrse. * / < , " 

9 



EJJC, 



SOURCE. Stephen J.-Frajich'ak, EliseoyiR. Ponce, Robert S/K. BtlJmgs, and Patrick A. O'Reilly. Guidelines and 
Procedures. Measuring the Training Satisfaction and Jfib Satisfaction of Former Vocational Students (Columbus. 
Thfc National Center for Research in Vocational Education, pie OMp State University,J981|, pp. 52-72, 78, 80. 
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-While there are advantage? to multiple items, -there are also disadvantages. As the scale gets 
longer, the marginal utility of additional items for increased reliability declines. It is of\en difficult 
to compose several items.that measure the same construct without becoming redundant. Such 
repetition can annoy respondents, who feel that they keep answering the same question (which,. in 
fact, is true). Additional iteVns .obviously increase the length of the instrument and may lower the 
■ response rate, cause fatigue, invalidate items near the end, and lower \he number of constructs that 
can be measured. It 15 suggested that, depending on the importance of the construct to the study, 
there" shodld be at least three but no more .than five items per construct. 

Determining What Questions to Ask 

You have.£lready lis^ed'the specific objectives of your study in measuring the training satis 
faction and jab* satisfaction of former vocational student^ These objectives should serve as your 
bases in determining what questions to ask. Theiexampie that follows illustrates how specific objec-' 
tives are'translated jnto specific items in the questionnaire: 

; * . ) 

x ^Specific objective: To determine the job satisfaction of former vocational students, 

class 1979-80, who are employed by the industries established^ 

/ o ' since 1975 in Brookings Ci^y 

■ Item for the qOesJiionnaire: - 1 

' ' J % * 

1 Rate the degree to which you are saftsf ied with the following asjdects of your^present job: 

; * ' .Neither 

\ , % Satisfied J 

' Highly * nor ' Highly , 

Satisfied Dissatisfied Dissatisfied^ 

(1) (2) * % {3i % \ * (4) (5) 

Salary * r*- ~. . - * - 

fringe Benefits . \: . * 

Workinq Conditions r 1 

Status ' % * : . 

Other (specify: - ft . ' * " ' l_ 



After all the items are written, you may want to group those that£re similaf pr related. Your next 
task is to arrange your gpoups of items in the questionnaire so that they are presented in cotrejbt 
psychological order to .the respondents. This will create a smooth-flow of ideas for the respondents 
who are answering the questionnaire. They shou Id not feef a$ if fhey,are being subjected to a quiz, 
or examination. As a*rule of thumb, difficult questions,are placed at the end. 

* n *• * 

Another, useful procedure for determining what questions to ask is suggestedby Selltiz, • v 
Wrightsman, and Cook (1976, p. 543). They sayj * . > ' * 

An excellent test of one's performance m this stage of questionnaire construction 
and, at the same time, a valuable aid, is the preparation of "dummy tables" show-^ ^ 
mg the relationships that are anticipated- By drawing up such tables in advance, , 
the investigators force themselves to tie finite decisions about what data are required 
and how they will be used, [italics added! 
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* • ' CHECKLIST 1 ' \ 
Decisions About Question Content 



Instructions: Examine each question in your questionnaire in terms of the following points: 



ti 



□ 



Yes' 


,/Vo 






n 


i. 




□ 


• 

2. 




□ 


3. 


□ 


□ 


4. 


□ \ 


□ 


.'5. 


6 . 


□ 


6. 



3. Do the respondents have th^jnformgtion necessary to answer the question? 

Is the question concrete,, specifiq, and closely related to the respondent's ' 
personal experience? • . 

Is the question content sufficiently general and free from too much 
concreteness and specificity? ' „ , - . 

Is the question content biased'or.loaded in one direction without 
accompanying questions to balance the emphasis?- 

7. Will the respondents give the information that tasked for? 



i 



v. 



er|c 



« » 



NOTE: Ideas in this checklist were taken from Cr. Selltiz, L S. Wrightsman, and S. W. Cb&k, 
Research Methods in Social Relations (New York: Holt, Rinehart and Winston 1976) 

x / - . • 1 ' . y/ ' 
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Before determining whether you used the proper wording, structure, and response .options in-j 
ytyjr questions<take a fetfv minutes to think about th# questions posed in checklist 1. It is worth 
ypur time to mo^ahead cautiously. Remember, the most troublesome errors in questionnaires 
''creep in unwiturrgly, ^ve'n in 'obviously simple questions' " (Selltiz, Wrightsman, and Cook 1976, 
p. 547)/ s i ^ , 

, Determining Appropriate Wording of the Questi5fi \ * 

* ' * v 

^tfter decisions'have been made regarding the questions to ask, tfou are ready to address one of 
the most important, as wejl as the jnost difficult, tasks-in the entire phase of the study-wciting a 
good questionnaire item. 'The formulation of good questions is hnuch more subtle and frustrating 
than is generally belifeved by those who have ngt actually attempted it" (Goode and Hajt 1962, p. 
132). Many experts believe- that the most important defect of commercial survey research is'improp- 
erly worded questions. . , " s 

In regard to question wording,,tw6 icnportapt, separate decisions must be made: deciding^ques- 
tjon structure and deciding actual choice of w^ds. Dillman (1978, p. 86) identifies four basic types 
of question structure according to the nature of response behavior asked of the respondents: open- 
^nded^tlosed-ended wfoh*ordered choices, closed fended with unordered choices, and partially closed- 
ended. Table 1 explains the uses, the advantages, and the disadvantages of these four types of question 
structure. ■ . 

The type of question structure to use depends on the kind oKiftformation the evaluator is 

• attempting to obtain in the survey. Selecting the wrong structure may^mean getting-the wrong infor- 
mation and receiving answer^ "to thp wrong evaluation questions. Additionally, the evaluator should, 
consider other factdrs such as staff expertise, time avail^Ble for the study, and financial resources. 
Analysis of results of certain structures, su<?h as the open ended .structure, demands considerable , 
expense money, a lot Of time, and a high degree of expertise tJacobs 1974, p. 10). 

• ' * 

Whichever structure is used, the key issue is to ipa^imize the specificity of |he item. The ' 
object being referred to shouW be cohcise and clear, particularly when the effects of vocational 
education are being evaluated. As argued in the preceding secjtion, any effects are likely to be very t 
specific anc[ will not be Identified by one global satisfaction question. . 

After a decision is made on question structure, the evaluator ne&tis to.decide on the actual 
choice of jvords.*"The wrong choice of words.can create any number (ff problpms-f.rom excessive' ' 
Vagueness to too much.precjsipp, from being. misunderstood . . . fromteing too objectionable to 
being too uninteresting anfi [ irrelevant"^ Dillman 1978, p. 95). Payne (1951, p. 9) adds: 

' Question viording involves more than toying with this word or tha.t tp see what , 

may happen, however. Ins more than v a mere'matter of manipulation of words \ y 

• .to produce sfci£pwsing illusions. The jnost^ritiCal'need for attention to wording 
is to make sure'that the particular issue which the questionnaire has in mind is% 

.'I < the particular issue on whicfi the respondent gtves his*answers. • 

• To assure that the intended issufe is understopd, then, is the fundamental func- 

' tion of question wording. A ^ 
, * „ * \ * 

x ' The goal, then, is to word carefully an3 clearly eac^question so that all respondents interpret 
it in the same manner as the question designers. "Generally,, the most effective questiQns are worded 
is simply>as possible" (Ber'die and Anderson 1 974, p. 39). Tabled shows sQme "don'ts" in question 
wording. Checklist 2 is designed to help you determine appropriate question wording. ^ k 

• • • * ^ 
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TABLE 1 
Types of Question Structure 



s 



1. Open-ended Questions 
Examples' 



• Jrvyour opinion/what is the most satisfying part of your vocational training?^ 

• What specific things a^out this vocational program have you found to be least 
useful to you ir? your present job? , * ■ » 



Advantages 



Disadvantages 



Lend themselves'to situations-in which respondents can express themselves freely 
and/or recall a precise piece of information without difficulty. 

V 

• -Are useful when researchers cannotanticipate the varipgs ways in which people 
. are likely to r.espond to a questioA. 

• Jend to stimulate free thought,,Be suggestive, probe people's memories, and - 
'qlar^fy positions.^ . N * , . ' A 

• Can be very demanding. The tasks of articulating answers is difficult for most 

. respondents, especially for those with low educational attainment and for those 
whojack experience in communicating ideas to other people. 

• Are time-consuming "for the respondents and may affect tfie response rate. ' 

• Elicit fchswers difficult to code and summarize. • * / ' <fc 



2. Closed-endepl Questions witfi Ordered Answer Choices 



Example 



* * * L -* I _ 
• Considering your vocational training, rate the degree to which you 
satisfied with each of the following: r : - \ 


are 


i 

Methods of instruction 


Satisfied 


Not Sure? 'Dissatisfied 


^ Facilities and equipment 








Guidance service 


□ - 


□ . 




Placement services 




CI. • 


n '• 


Cooperative work experience 


□ 




LI " ' - 


Apprenticeship training 


EE 


L • 





Advantages 



Disadvantages 



-ill 



• Are suitable for determining such things' as intensity o£ feeling, degree of involve- 
ment, and frequency of participation. ^ *- 

• Elicit responses suited to many forms of statistical analyses. 

• Place little demand on respondents. , r , h 

I • ~ ^ 

• Tend to be very specific, causing respondents to think about a limited aspe^tof 
life-in a limited ttay. Having,a response dimension narrow in scope enables 
respondents to place themselves at the most appropriate point on a scale implied 
by the answer choices. Only appropriate if the researcher has a well-de/ined issue. 



KLC 



Table 1 (continued) 



dlosed-endfed Questions with Unordered Answer Choices 



Example 



• Which one of the following aspects of your vocational trainin&^re you most * 
satisfied with? (Check one) 
* 

LTJ Methods of instruction 

□ * Facilities and equipment " y 
J Guidance service 

□ placement services 4 / 

□ ' Cooperative work experience 
' CD Apprenticeship training 



Advantages 



Are useful for establishing priorities among issues and deciding among 
alternative policies. ' 

Do noj'limit responderfts tp choosing among gradations o.f a single concept. 
Each choice is an independent Alternative representing a different concept. 



Are generally more difficult to answer than those containing ordered answer 
choices] inasmuch as respondents must often balance several ideas in their 
»' minds at the same tirne. 

Disadvantages 

Preclude obtaining useful resolts unless the researcher's knowledge of the subject 
allows meaningful«choices to b>s stated; possibly eliminates the most preferable 
^option of the respondents. ' . n 



**> * • 

4. Partially Clo^ 


d-ended Questions . . # 






• Which one of the following aspects of your vocational trafning are you 
most satisfied with? (Check one) > ' 






l/i Methods of instruction 






M ^Facilities and equipment ; 






[ 1 Guidance service • ■ ' 


s 


/ Example 

■9 

\ 


( J Placement services 

* * . 

L~' Cooperative wor4oexperi£nce , 
* 

T I Apprenticeship training \ \J . 

* * « * 

□ • Other (specffy: 4> * - ** ) 




* Advantages 


0 Allow building of variables and testipg of hypotheses. 

• Preclude fprcing respondents into boxes in which they clearjy do not fit. 
' • • * ** 




Disadvantages 

m ' 


• Seldom obtain sufficient ^number of additional raspoftses in the open-ended 

option. r 

\ • *• ' 
d . t 





emc : 



NOTE: In making this table, som t e ideas were faken from D. Dillman, Mgil and Telephone Surveys: - 
The Total Desigq Method (New^York: John Wiley &Sons, 1979). 
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Determining Appropriate Ftesponse'Options ; 

• A well-constructed questionnaire includes both proper wording of questions and proper 
response options. Confusing options increase measurement error (unreliable result?) and the per- 
centage of nonresponse rate. The ,fo)lowing suggestions (Berdie and.Anderso'n 1974 pp 45-47) 
and examples are offered to help you de^gn appropriate response options for questionnaire items: 

1. Make certain that one response category is listed for every conceivable answer. To omit an 
option forces people to answer in a watf that does not accurately reflect reality. 

. Example: In your opinion, what is the most satisfying part of your present job? 

(check one), ' / 

— ^ p 

Poor Options (very few choices) better Options (more Choices) ' . 

^Salary ' ■ __ Salary 

_ Fringe benefits j Fringe benefits 

Working conditions 

< ' ; Coworkers 

.Others (ple.ase specify ) 




2. Include a "don't know" response option whenever respondents may be unable to answer ' ' 
Although a "don't know" option may be viewed as offering respondents an "easy out " it- is 
probably better to include this option .than to take the chance of obtaining inaccurate' 
mformation by forcing people to respond to an item about which they know nothing. 

Example: In your opinion, what aspect of your vocational training needs the most 
■ improvement? (check one) 

Poor Options " Better Options , 

Facilities and equipment ^_ Facilities and equipment 

ws, Te'achers \ Teachers 

9 — 

. ta Apprenticeships/coop 4 Apprenticeships/coop 

Others (please specify: r ) 

* ' . ' Don't knoyv 

3. Make response options mutually exclusive and indepepdent. 

Example: I n your option, what is the most satisfying pant of your present job? 
(check one) ' - 

\Poor Options ■ , Better Options 

/(option's not mutually exclusive) (options mutually exclusive) 

Salary* ^ Salary 

! , Medical benefits ■ - r Medical benefits 



Fringe benefits Other fringe benefits" 

Working conditions \ Working conditions 
Sta tus - ' / statgs 



Others (please specify: 
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' CHECKLIST. 2 



Decisions About Question Wording 



• Instructions: 


Examine each question carefully in your questionnaire in terms of the > ' 
following points: • ' 


Yes 


Nq 


* » 


JO 


□ 


* 1. Car> the question be misunderstood? 


L T 


r i 
1 i 


2. Does it contain unfamiliar Or unclear phrases? 






3. Does the Question adequately express the alternatives with rjespect 
. to the point? ' 


□ 

<* 


□ 


4. -Is the questMCfti misleading because of unstated assumptions or 
unseer^implications? * • * 






*'.•.[.• • • ' 

5. Is the wording biased 7 . * ' 




c 


6. . Is it emotionaLjIy loaded or slanted toward a particular kind ot answer? 

* 




□ 


7. Is the question wording likely to be objectiQnable to the respondent 
— „ in any way? ' 


□ * 


Li 


8. W'otild a more personalized or less personalized wording of the question 

produce better results? 
■ * 




• r r 


* 9. Can the question be better asked in a more direct or a rrjore indirect form? 

r , 



r ■ ^ 



NOTE: Ideas in making this checklist were taken from C. Selltiz, L. S. Wrightsman, an«V. Cook, 
Research Methods in Social Relations. (New York: Holt, Rinehart and Winston, 1976). 



•>' TABLE 2 

Some Pon'ts in Questi 



on Wording 



Ambiguity 



T7 



Avoid questions that are incomplete, imprecise, or indefinite. 

p An incomplete question is likely to lead to confusion. 

An imprecise question conveys an unreal meaning or suggests an. 
inaccurate answer. ■ 

> An indefinite question-contains hazy words^(e.gr "frequently " 
* "usually/' "often," "always," etc. * * 



Misperception 



-Loading 



Special, 
* Wording 
* Problems 



t Avoid questions containing words that lie outside the respondents' ' 
experiences andhave^Tan^eahing to them. 

Avoid questioftTcbntaming words so familiar to respondents that they 
may be confused .with simjlar-soundifig .words. 

Avoid questions that violate local idioms. When a question is worded 
contrary to expectations, respondents are likely to respond, nonetheless, 
' in terms of their expectations. * ^ 

• ' ' • x ' • . : ^ 

. A question is^ loaded whefn something in it suggests to the re'spondertts 
that one particular response-is more desirable than another. 

A question is loaded'when it provides unfairtilterna'tives. 

A # * • ^ ' 

A question is loaded when it contains emotionally charged words or 
stereotypes. * « . . " " , 

A question is loaded when it is embarrassinq. 

Avoid questions that assume too much knowledge on the part of the 
respondents. ' 

Avoid lengthy questions, such as two-part questions. * 
Avoid use of Rouble negatives. 
Avoid illogical sentence construction. 




NOTE: Jdeas in this table were taken from.C. H. Backstrom and G. D. Hursh, Survey Research 
(Chicago: Northwestern University Press, 1964). fl 
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4. Balance all scales used in the response options, Include an equal.number and degree of options 
on each side of a middle position. ; . • " ■ 

.Example' - Please rate the decree to which you are satisfied wjth the following* ' * . 

, Poor Scale {unequal number of options on each side of the micldle position), 

* • I 

Neither . „ 

Satisfied « . 

.nor 9 * Highly - . £ 

Satisfied Dissatisfied Dissatisfied Dissatisfied , 

- • ' (D (2)- ' (3) (4) 

Salary w . J ' t . ~ r 

Fringe benefits _ >^ ' '_ 

Working conditions # 9 : - ^ ' * - 

Status * : * 

Others (please specify: J - . ^ I • " • N 



Better Scale (equal number of options oh each_side of <he middle position) 



Highly 



Neither 
Satisfied 
nor 



Salary 

Fringe benefits 
Working conditions ' 



hjfghly 



Statuf * 



/ 



Other^jpleas&specify: 



Satisfied -Satisfied Dissatisfied Dissatisfied Dissatisfied 



*(D- 



(2) 



(3) 



(4) 



(5) 



5 Make.sure to label fife midpoint according%to.the "exact'' meaning^he scales require. ' 
Example: Please rats the degree^to which you are satisfied with the following: . . 
PooPScale (midpoint not labeled) 

H\hl 



Salary * 
. Fringe benefits 

Working conditions 
✓ Status 

Others (please specify: 



Highly 
itisfn 

(11 



^Satisfied . Satisfied 
(2)- 



hl y> 

Dissatisfied pissaAisfied 
3) ' " (4) (5) 




EMC 



Better Scale (midpoint labeled according tcthe exact meaninq)' 

• . / Neither 

> * / Satisfied 

Highly . nor Highly 

" Satisfied Satisfied Dissatisfied * Dissatisfied Dissatisfied 

ID (2) (3), (4i ^ ' (5) 

Salary' ' . t * 



Fringe benefit? 
Workipg conditions 
Status 

Others (please specify: 



Irs 

onses ver|i( 



6, Arrange responses vertically. 

.Example: In your opinion, whar aspects of your vocational training needs the^most 
improvement? (cfieck one) ■ 

Poor ph&onse Arrangement (Yior\zon\a\\y arranged) 

Facilities and*equipment : Teachers 

. Apprenticeships/coop ** Others % • 1 

Don't know ^ ? 

Better Response Arrangement tvertically arranged) * • 

; Facilities and equipment , 

^ Teachers , * 

: Appfenticfestyps/coop 

. Others* 

, 4 

k Don't know . " 



7, Make certain the respondents know exactly what information they should put in the 
blanks of fill-in-the-blank items. * . 

» « 1 v 

Poor Direction: . ^ ; Better Direction: 

/ = 'f. A 9e in years ^ \ ^ years of age at last birthbay 

• 

Now you are probably ready to write your response captions. Afteryou have written them and 
* before you begin toread the, next section, take a few moments to review younresponse options by 
following the instruction? in checklist 3. * ' ' - „ . 



( 



9 
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CHECKLIST 3 . 
Deciding about Response Options 



Instructions: Respond to the following questions as appropriate 
''1 . What type of response options are present in your mailed questionnaire? 



t 



■ 1. 

2/ 
% 3. 

4. 



2. ff a checklist is used/ % 

1. Does it cover- adequately all-the significant alternatives 
without overlapping? 

* V 

, 2. 1 3* it of reasonable length? 
3. Is the wording of items impartial and balance^? 

3. Is the form of response — ' 

1. Easy? 

2. Definite? 

3. Uniform? 

4. Adequate for the purpose? * 



□ Yfes* <□ No 

□ Yes\ □ No 

□ frfes , □ No, 



r 



□ Yes 

□ Yes 

□ Yes 

□ Yes 



□ No 

□ No 
No 

" No 



A 
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\^ • • • 

« * 

Pretesting N . . * ^ 

* * ■ ■* • 

• * ♦ * • * • • • 

The reader is forewarned that good question construction requires a deliberate process entailing 
considerable investment of time and material resources. Jt'can be a frustrating process f 0 r evalu<rtors 
especially if they need to meet short deadlines. Oftentimes, it involves pretesting to reveal the 
questionnaire's weaknesses. Lundberg (1942, p. 198) warns: ' , . ~> 

/J V. 

- ' The inexperienced researcher is likely to be impatient with this preliminary; 

.work, which may seem like hair splitting over the meaning of words, apd other ' 
< r details. But patience and care in this preliminary work may make all the 

difference*be.tween success or failure, both in the cooperation of the respondents ' 
• and in the reliability and validity of the results. s 

, ■ Pretesting can be informal^ formal. The most important aspect of the.exercise is to pretest the 
-questionnaire with responded representative of the group tff former vocational students who Will 
■ eventually re'cfcive it. If the evaluator desires,.pretesting can generate data that will reveal the read- 
ability reliability, anckvalidity of the instrument. (Foradditional discission on the subject 'see 
- FrSncjjpk and Spirer 1978 and McCaslin and Walker 1979.) 1 

# . , t 4 . How to Increase the Generalizability of Data 

. Collected by Mailed Questionnaires. 

As mentioned earlier, one of "the most serious problems of usingjhe mailed queStionnairCis low 
response rate. Partial returns "may introduce bias that wffi rend'er the obtained data useless "*( Van /" 
Dalen 1973, p. 325). Inadequate response is especially critical if questionnaires have been sent to a 
sample,-because the resulting summarized data' may not represent the true response of all the target - 
respondents. As a result, generalizability of the data collected and their usefulness for decision making 
and program rmproveflrient are impaired. 

This section. details some valuable strategies for increasing the response rate of mailed question- 
naires. Stcategies are^ focused on preventive tactics; that' is; the removal of possible causes within the 
evaluator's control that prevent the respondents from^nswering and returning the questionnaires. 
Included are proper format considerations aipd other strategies for stimulating response. 

< *ii 

« Format Considerations 

* * ■ ■ ft 

\ t -proper formulation of the instrument is ^'critical phase of questionnaire development. 
Improper form jt not only creajtes problems for tfata coders and tabulators, but also can lead to 
misinterpretation of questions (thus increasing Measurement error) and lew response rates (thus 
^ weakening the generalizability of results). Cacfiiul consideration mustbe given to two areas when " 
» m format decisipns" are made*. 

* * . r • : / ■ « 

4 1. Th& respondents'! 'former vocational education students). The format should enable 
' W .* ?res P ondents t0 re .ad and answer questions as easily as possible. Keep in mind that com- 
\" • pitting a questionnaire is an imposition. 



y 2!' Data coders and tabulators. The format should allow easy data coding and tabulation. 



Gqode and Hatt (1962, p. 43) st&cinctly summarize the important principles to observe in 
formulating a-questionnaire: , |?* ..«.*' 

bommon sense dictates certain practices about the design of the mail question 
naire. The .mail questionnaire should be attractive and easy to fill out, have 
adequate space for response, and be legible. A neat, well-organised, attractive 
questionnaire should increase the response rate. This assumes tftat people 
associate appearand with quality and are more willing to complete and return 
the form. Conversely, a sloppy, crowded, or poorly reproduced questionnaire 
will have adverse effect on response rates. 

Checklist 4 will help you review and improve the format of your ^riail questionnaire. 

Strategies to Stimulate Respipnse 

Following up nonrespondents.is a difficult and costly process. It is, therefore, important to 
exhaust all means to keep the percentage^ nonresponse as tow as possible. Thte Emphasis should be 
op preventive tabtrcs (i,e. A the employment of strategies prior to the receipt of the questionnaire by 
the respondent^). , > • 

Do'you know youKrespondents? Have you anticipated all conceivable objections to their 
^ answering and returning' the questionnaire? These questions are crucial'in devising specific strategies 
' to stimulate response. Your tactics should be tailored to your specific respondents, former voca- 
tional students, and should include techniqbes appropriate fot; this particular group. 

The ultimate objective is to obtain as many responses as possible, in the fo/m of* 
completed 'questionnaires, which pgpvide usable data. If questionnaire forms 
-fa^et criteria of physical attractiveness and obvious consideration for thef respon- 
dent^* is believed that the percentage of repties-yviM be sufficiently high to fulfill 
the requirements of the investigator. E^gry conceivable inducement should be ' 
* used in the hope of convincing one more potential respondent to' take the time 

andx^ffort necessary to Answer the questionnaire. (Nixon 1954, p. .486^. . ' 

Inducement for the respondents to reply can include making precontact either £>y telephone or, 
mail, preferably by someone who is known by th3 respondents (e.g., former vocational teachers or 
l^idance counselors). In addition, the evaluator may use material or monetary inducements such as 
sending cash or small gift items such as pencils, school decals, or.buttons; or evaluators could use a 
raffle as an inducement with the respondents included in a raffle if tj/ey return their questionnaires. . 
Scrtne social researchers find that such inducements do increase sigi/ficantly the rate of response. 
N * * 

Another stotegy for increasing response^rate is to start an early campaign to inform your^ ' 
target population. Some local schools begin their information drive while the students are in their . 
senior year. They are made aware of the objectives and importance of*the study and their role in it. 
So, before graduating, the students know already that they will be participating in a follow-ypStudy. 

tr 

Now, let us pause and take a hard look at your completed questionnaire. Checklist 5 is designed 
to hetp you review the strategies that you have selected to stimulate response. Remember, "An ounce 
of prevention is better than>a pound of cure." 
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CHECKLIST 4 
Format Considerations 



Instructions: Examine your questionnaire format in terms of the following considerations. 
Yes No 



n i □ 1. Is the questionnaire "appealing tothe eye'" and as easy t<^complete as possible? 

□ C1 » 2. Did you numbet question najre items and pages so the respondent will not become^ 

confused while completing the forrh? 

» - * 

* - 

□ ' Q 3. .Did you put an identifying mark on each'page of the form so that if one page 

. should get separated from the rest,* it can be reattached? 

[IT □ 4. Did you pu"t the name and address of the person to whom the form should be 
returned at the beginning and end of the questionnaire even if you included * 
a self-addressed envelope, since questionnaires are often separated from the cover 
letter and [the envelopV 



□ * □ 



5. Did you put the study^title in bold type on the first page of the questionnaire? 



□. □ 6. Did you include bAtef and clear instructions (preferabl^old or ftafics) fpr 



completing^the form and additional clarification and examples ttefore sections 
that may be confusing?' ' 

□ □ '7. I£the question led up to in a^ndfturaP way (i.e., is it in correct psychological order?) 

* □ □ 8. Did you begin with a few interesting nonthVeatening qirestions^btfcause 

/introductory questions that are either threatening or dull may redifce the 
" , likelihood of the subjects completing the questionnaire? 

□ □ -* 9. Did you avoid putting important. items "at the end of a long questionnaire? 

□ □ 10, If questions appear.on 4 both sides of the page, did you put the word "over" on ' 

the bottom of the front side of that page? 4 ' 

" * 

□ □ 11. Did you try to make smooth transitions between sections so that the respondent 

does not feel he is answering a series'of unrelated "quiz" questipns? 



NOTEr Ideas'in this checklist were taken from Douglas R. Berdie and John-F. Anderson, 
Questionnaire: Design and Use (Metuchen, N.J.: The Scarecrow Press, Inc., 1974) and 
C, Selltiz, L.S. Wrightsman, and S. W. Cook, Research Methods in Social. Relations (New 
York, New York: Holt, Rfnfehart,and Winston, 1976)* ^ 
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CHECKLIST 5 
Stimulating Response 



Instructions. Take time to review your^strategies to stimulate response by answering *he following questions' 
1. Hovrwill you relate (i.e., formally or informally) to your sample of for/ner vocational students? • + 



2. How will you be'able to guarantee* resp'or^ent's arpnymity or confidentiality 7 . 



J 



3, Will your correspondence and questionnaire be printed m the most professional and appealing manner 7 

□ Yes D^o , , , ' 

4. Have you carefully iconsidered the content and approach of your preletter and cover letter? < 

□ Yes □ No • 

j 5. Have you considered offermqlsome type of incentive (such as giving the respondent small cash or gift items) 
to encourage responses 7 i 

□ Yes . No 

6. Have you identified sufficient resources "from which to obtain updated actresses of people in your study 7 

* □ Yes " £l No ' 
V < 

7. ' .Whei^e is the best plaqe to send the questionnaire to the respondents? 

D work 7 ' home 7 O both work and home? ■ • 1 

8. Have youionsidered using "high-powered" mailing tactics (sucH astfie use of special delivery, certified, or 
first-class mail) to stimulate responses 7 , * 

QYes QNO ( * '* 

9. What metrfbds will you employ to determine why people are not returning completed questionnaires? . 



10. Have you allocated suffictent-resoUrces to follow-up honrespondents 7 □ Yes □ No 

1 1 . What method have you considered using for follow-ups? * 



12. Will your follow-ups be: humorous? □ serious? □ combination of >oth? 



NQ^E: Some ideas in making this checkto were taken from Douglas R. Berdie and John F. Anderson, Questionnaires- 
Design and Use (Metuchen, NJ. The Scarecrow Press, Inc., 1974). 
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low to Increase Confidence in the Data 

Collected.by Interview • * 

As emphasized in the previous chapter, exercising methodological control for reducing measure- . 
merrt error should be a continuing- important 1 concern for both the evaluator and the researcher • 
Data reliability— a major determinant of data -usability-is very much a 'f unction of methodological 
rigor. Additionally, when the interview schedule is finalized, mucn investment' (time and money) 
has been made on the study. Thus, no effort must be spared in ensuring that complete, accurate data 
are collected. Preliminary computer processing and data analysis for Initial results can be undertaken 
to detect certain -errors. These preliminary efforts may minimize the study cost and time of the-studv 

In using tne interview, the evaluator needs to pay particular attention^ measurement er>or 
from two vantage points: question construction and interviewing process. The principles and tech- 
niques discussed in the previous chapter regarding determination of question content, structure and 
wording apply also in ftymulatingquestions for the intervie^. Although interviewers have greater 
flexibility in asking questions than the mailed questionnaire (e.g., use of open-ended questions or gse 
of probes), the basic principles of question construction and.the factors to consider i,n making decisions 
remain t+ie same. Questions -should be clear and unbiased with each one focused on a single thought 
or issue. To the extent possible, the language and syntax of the questions should correspond to that 
of the respondent., v ' * », 

On the other hand, the best constructed questfons.will not be' of much value in collecting valid 
and useful data' when posed by unskilled or biased interviewers. Though many 1 hours may have been 
spent in perfecting the interview questions, in the final analysis the.utility and effectiveness of a 
questionnaire in getting valid and useful information depend upon the interviewer. The following 
subsection details some strategies and techniques for "reducing data distortion during the interviewing 
process-and includes some useful techniques for probing answers. v 
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^ * 1 : Principles of Interviewing \ > * ; " 

, The followmg interviewing guidelines are cited in the^'Locally Directed Evalua'tion-lllinois 
Office of Education" (Illinois Office of Education, 1376) and gi\/enas Suggestions when applicable. 

Interviewing is.a basic a&essment njiethod. An interview is not just a conversation; it is, rather; 
a carefully thought-out technique for finding out from respondents how things are and how people 
. feel and think. The interview itself is not intended to change or influence the respondent. The inter- 
viewer, therefore, must bean understanding person, capable of accepting what the respondent says 
without judging or rejecting. * 

a. The respondent needs to see* the interviewer as someone who is not a threat to his/her ^ 
immediate or future well-being, nor to his/her self-esteem. % • * 

b. -The respondent needs to' see the evaluation itself as/not posing a threat. 

c. The respondent needs to understand, even in a limited way^the purposed the* „ 
evaluation, the reason for selection, "and the necessity for cooperation. 

d. The respondent needs to see the interview situation as a pleasant way pf spending 
some'time. ' • / T 

e. The respondent needs to feel, after the interview is completed, that it was a real »' 
opportunity for free expression on a particular subject 

To meet these needs of the respondent, the interviewer must be conscious of the style and the 
content of the interview. The following are suggested techniques that help to ensure a good inter- 
viewing relationship, as well as to obtain an accurate, unbiased^interview: * * 

' • * .; ' " 

a. Be friendly and informal, but at the same time, professional.' . . „ 

' b. Be a sympathetic, interested, and an attentive listener. Be neutral with' respect to>t'he 
/ subject matter.wDo not express your own opinions either on the subjects being discussed 
by the respondent or on 1 the respondent's ideas about those:subjects. 

c. Be observant. Be alert to the respondent's manner of expression and use of gestures. 

d. Last, but not least, be at ease yourself in the interview situation. If you feel^hesitarjt, 
embarrassed, hurried, or awkward, «the respondent wiJI soon sense this feeling and * 
behave accordingly. * m 



. Using the Questionnaire in Irtterviewing 

. . \* A ' , 

. Cdllection of accurate and useful information is the goal in using the interview schedu%, which, 
' is the interviewer's guide in posing the questions to the respondents It should be impressed upon 
injprviewers that "each question has been carefully pretested to express the precise meaning desired 
in as simple a manner as possible-even a slight rewording of the Question can so change the stimulus 
as to provoke answers in a different frame of. reference or bras the response" (Selltiz, Wrightsman, 
and Cook 197§, p. 564). To' this effect, Backstrom and Hursh (1963, p. .139) (rffer the following ' 
suggestions: * * 

^ * y 

SOURCE': Catherine P. Warmbrod and Jon J. J>ersavich, eds. and comps., Postsecondary Program Evaluation (Columbus. 
National Postsecondary Alliance, The National Center for Research m Vocational Education, The Ohio State Unive&tv* 
1981), pp. 14-15. . * yr 



v: 



1. AlwaVs follow instructions carefully.^ ' * v . 

2. Always study the questionnaire untfl you are famifiar vyitli all the questions. * 

3. Always use the brief introductory approaqh written into the qu%stioDnaire? 

4. Always be completely neutral, informal, Conscientious. * • , 

5. * Always read questions just as they are vfaTtten. v * 

6. Always ask all ofthe questions. . % 

7. Always ask questions in the order they appear. «, 

8. Always record comments accurately. ' . - • 

9. AlVvays interview pnly the proper person*. . . designated by your procedure.' ^ 
1 0. Always check each questionnaire to make sure you have completed every item*. * 

W. Always interview people you dor*^know;and rnterview them alone.-, " * ' ' 

However/Dexter (1 §79; p. 23) cautions that there "is no set, of ultfversal rules that govern all ' 
situations in interviewing. In the ultimate analysis, "every suggestion about hoyv.to conduct inter- 
views must depepd upon these all-important' variables: ^personality and skill of ttle-intervtewer, 
the attitudes*and orientation of the interviewee, and tfie definition.by $th'(and often by significant 
others) of the^situation" (Dexter 1979, p. 24). • , ,^ " ♦ 
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Probitig and Other Interviewing Techniques-* 



1. 



V 



• • It is relatively eaSy for interviewers to, ask questions and record answerlFhlowever, obtaining^ 

specific, complete response, which is crucial to the interviewing process; requires skilf It is not 
uncommon for some respondents ta4mswer "Don't know" in order to avoid thinking abdtit a 
question, misinterpreting the-quesflorvor contradicting themselves. In all these critical cases the 
*■ interviewer can use probing techniques. • • 

Probing is a technique'that motivates respondents to communicate'fully so that they enlarge 
y on, clarify, or explain the reasons behind what they have said. At the same time, it helps the respon- 
dents focus on the specific content of theinter.yiew so that irrelevant and unnecessary information ' 
. can be avoided (Institute for Social Research 1976, p. 15). A good interviewer, therefore is alert 
in detecting incomplete or vague an'swers and skillfully uses neutral probes to elicit complete^ecific 
information from the respondents. This technique requires the interviewers to understand the objec- 
tive of every question. It is only through "complete understanding of the question that the inter- 
, viewer can recognize when and where probes are needed and use them effectively" ( Institute Tor 

Social Research -1976, p. 16). Toward this end, the following useful techniques for probing (Institute 
, for Social Research 1976, pp. 15-16) are suggested: •• * 

Repeat the question. When respon'dehts'do^not seem to understand the question, when 
they misinterpret it, When they seem unable to make up their minds, or when they stray 
from the subject, the most useful technique is to'repeat the question just al.it is written 
, in the questionnaire. *. " . ' f , 

2. Usegn expectant pause. The simplest way to convey to respondents that you know 
they have begun to answer^he-question,-but that you feel they have more to say, is to ■ 
besilent. The pause-often accompanied.by an expectant look or a nod of the head- ( 
givtes the respondents time to gat'her their thoughts.'- ' X 

\ - .. . > * ' >y 

. - 3. RepeHfhe respondent's reply. Simpjy repeating what the respondents have said'as 
'„ • f s ° ona j the y h avestoppe4talkingisofte^anexcellent^robe. This repetition-should 

be made as ^ou are writing>so'that you are actuafly repeating the respondents' reply 
and recording-it at-the same time. Be sure also that you are understood correctly. 

4. Use neutral questions or comments. Neutral questions or comments are frequency 
used to obtain deafer and fuller responses. The most comnjonly used probes include: 
i • Let*me repeat the question. 

*V • Anything else? • ■ ' 

. tf J • • Any other reason? * * " 

•«Any others? ' " • 
■ • "What do you mean? , ^ 

• Could you te+l me more about your thinking on that? 

• Would you tell me what you have in mind? ' * 

• Why do you feel that way? 

• Which would be closer to the way you feel? =f 



S 



SOURCE: Stephen J. Franchak, Eliseo R. Ponce, Robert S. K. Billings, and Patrick A. O'Reilly. Guidelines and 
Procedures. Measuring the Training Satisfaction and Job Satisfaction of Former Vocational Students (Columbus. 
The National Center for Research in Vocational Education, The Ohio State University, 1981), pp> 80-88. 

3 :< , , 
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. 5. Ask fuhher clarification. In protfing, you will Sometimes find it useful to appear 
slightlyWwildered by the respondents' answers. For example: "I'm not quite sure 
I know tohat you meah byAhat-could you tell me a little more?" This technique, 
however) should not be overplayed. 

\ 

Dealing with Interviewed Bias r — * fr ^ 

lnterviewer'sJ3ias-''k^stematic differences from interviewer to interviewer pr/ofc^asionaHly, 
systematic errors on the pa^tjof many or even^all interviewers"-affects the validity of evaluation data 
collected through irfferview ^Selltiz, Wrightsman and Cook 1976, p. 570). Personality and derpo- 
graphic characteristics of the interviewers and situational factors may influence the responses of the 
respondents (Van Dalen 1973,^p. 329^330). Thgs, different interviewers will not always elicit the 
same responses even from equi\)ajfent groups of respondents. Interviewee's bias is, therefore, a reafity 
of which every evaluator needs to be aware. The most common techniques \ov reducing interviewer's 
bias include the following: \\ "** , 

* 9 ' V \ ' * ° * 

1 . Properrfeieot'ion of interviewers. Common sources of bias sources are the interviewer's 
preconceived ideas or perceptions of the situation. iPthe result of the survey is a * 
possible threat to the interviewers in^any way (e.g., posing a threat tp personal interests 
or beliefs), interviewers likely Introduce bias (Selltiz, Wrightsman'and Cook 1976, 
p. 572). A good evaluator .should take -into account the foregoing consideration when 
selecting intervfewers. N6w\ake a. few minutes of your time to complete Checklist 6 

to help you in the selection 6$ interviewgrs. ■ \ 

2. Standardization of the interview. Thls^rocedureNncludes use of standard wording in 
interview questions and standara instructfonsjbn probing procedure, classification oK; 

1 ' - doubtful answers— suggestions all aimed at minimizing interviewer's bias. 4 . 

3. Appropriate training of interviewers. Untrained or improperly tr^iri^Linterviewers ^ 

- are certain to manifest greater bias than thos^ adequately trained. The training proGeduf^ 
should include the'foUowing experiences: how to make initial contact, how to secure s> 
the interview, how to use the'questionnaire, how to make u& of 'probing and,oth*er 
interviewing techniques, and how tp record and edit the interview. Needless to say, 
interviewers need to know the objective of every question and the possible sources of 
data distortion, including ways of dealing with this distortion. Additionally, Van Dalen ^ 
(1973, p. recommends that the interviewer be kept ignorant of both the hypotheses 
being tested and the data returns. Knowledge of such information may create bias, thQs 
influencing the marnner ir> which the interviewers conduct the interview* * ' 

A.^Troper motivation and close supervision. I Horror stories on data being^'manufactured" 
by inten/tewers in the comfort of their motel rooms'are not uncommon. Such an even-' 
tifelity can be avoided if interviewers are properly^upervised and made to understand 
the importance of getting complete, accurate information. The evaluator should be 
aware of the possibilities of. bias at various points in the data collection process and 
institute proper safeguards of minimising it (Selltiz/Wrightsman and Cook 197,6, p. 572). 
Whenever resources permit, it is suggested that a field visit be made at least two times • 
during jiheJnterView period-a visit after one-lhird of the respondents~are interviewed 
and another visit after two-thirds of the respondents are interviewed. The visit may - 
include checking orv£he*interviewers' problems, progress^ and accuracy of work. 

Accuracy of work is accomplished through spot checking. This may involve a visit by 
the evaluator to a few randomly selected respondents who have been interviewed. They 
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CHECKLIST 6 
Selection of Interviewers 



c 



Instruction:' Please respond to the following questions: 
1. How many interviewers do you need? ■ ' ' 



2. "What special qualifications are required? Please list them. - 



■ 1, 
2. 
3. 



4. 
5. 



3. What personal characteristics are required? Please list them., 
1. ' 



2. 



3. 
4. 
5. 
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are asked if they were in fact interviewed, includjng approximate length erf interview 
time. ^However, when resources do not allow you to provide actual field supervision, j . 
you m£y either use the telephone or postcards as means*offollow-up. Select a randorp 
sample of respondents and contact them by tetephone,or by mail^ using an easy to-fill- 
out self addressed, stamped postcard verifying whether or not thev participated in the 
interview. These procedures are important in checking whether the interviewers are in 
fact doing their job and not fabricating results. 

# '5. Reviewing completed instruments by the eva/uator. It is suggested JhaLdtter the inter- 
viewers have turned in their completed interviews (at different points/of tome during 
the interview period), the evalliator go through each compley^ interview meticulously 
and. check jf all necessary questions are answered; Check ^Iso to see that thdrtf are no 
missing pages. Staple each' set securely .^The front pages of thpsethat pass the inspection , \ 

s . should be initialed and dated, those incomplete s>r highly doubtful questionnaires rhust 
be completed or discarded, and respondents should be interviewed again whenever pos- 
' . $i£>le. After the Questionnaires are inspected (i.e., those with compfet$a/?$v<veAVand pages), 

^ th^y should be creposited4ri one place. If possible, tie all returns from oTie place and label 
them appropriately. „ 



J 



Checklist 7 is designed to help you deal with the problems of minimizing interviewees bias. 
Dealing with Social Desirability Bias . 4 

> Another important source of dat^distoflS^ is desirability bias, which is "a tendency to offer \ 
socially desirable answers ... to answer question^ in a way that conforms to dominant beliefs or J 
patterns among groups to whichThe respondent feels some identification or allegiance" (Dijlma'n 
-19,78, p. 6£). For example, some of your respondents may be located in communities Where partic- 
ular schools are known to be popular. Socially desirable response bias is manifest when former voca 
tional education students say e they are satisfied with their graining, ever} though they are not, because . 
they do not want to express an opinion that runs counter to the dominant view. 

/ " ^ 

There is a greater probability of social desirability bias in face-to -^ce interview than with use 
of a mailed questionnaire. Such a probability can be compounded if the interviewer is personally 
knewn by the respondents orjf the interviewer ii known to be affiliated with the-schoOl. The * v < 
following tfechnique&'are suggested to minimize social desirability bias: 

1. Use of telephone interview or mailed questionnaire, " / 

2. Employment of interviewers not personally known by .the respondents. The use of * 
vocational teachers or guidance counselors as interviewersfeflen with the use ei the 
telephone, is discouraged. V < r 



How to Increase Generalizability of Interview Data- 
Good methodology dictates that y5u should strive totjet 100 percent usabt^f^turns^i.-e., jcom- 
; plete, accurate answers) from ev x ery selected respondent, especially if ^ou have $ .random sample. In 
/ . cases where only a certain percentage of the sample reply or in cases where some completed interview 
'schedules have to be discarded because the answers ar^inaccurate, it becomes inappropriate to gener- 
alize to the total populatiorrfrom the data collected. 
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CHECKLIST 7 
Minimizing Interviewer's Bias 



Instructions: Please respond appropriately to the following qi^stions: 



Yes 


No 






□ 

f 


□ 


1. 


Is the interview standardized allowing the interviewer as little free choice 








as possible? 






.2. 


f 

Does the interviewer's, training include tfoS following aspects of the* study 


a 


□" 




• Objectives of the evaluation * 


9 


□ 




• Objectives of every question - ^ 


n 


n 




• oources ot interview oias ^ 






3. 


Is the inter^ewer trained in the following areas? 


□ ' 


□ 




• Making initial contact 


□ 


□ 




• Securing the interview 


□ 


. □ 




• Using tfie questionnaire 


a 


□ 




• Probing and other interview techniques 


D 


- □ 


t 


• Recording the interview 


'a 

•* 


□ 




* a 
• Editing the interview r V 


a 




4. 


Is there a mechanism for providing a regular check of 'the data collected? 
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In this section, discussion focuses on strategies for increasing the rate of participation in order 
to increase generalizability of interview data. The following procedures are offered for the evaluator's 
consideration: < * v 

^ 1. Identify sufficient resources from which to obtain updated^addresses of former • 

vocational education students. ^ $ 

2. Determine the best place to ser\d precontact letters and the best site for the interview. 

3. Design all correspondence in the most professional and appealing format. 

4. Consider using the telephone as a method of precontact. Infft-m the respondehts of . 
the purpose and sponsor of the study, and explain that a trained interviewer will call 
eft their addresses. 

5. Ensure that interviewers are trained to make proper initial contact— both at the de^or 
and inside the house. The Institute for Social Research at the University of Michigan 

/ • (1976, p. 7) offers the following advice: 

At the dooc^tep you should^tate the-course of action which you 
desire rather than ask permission for the interview. Forinstance, 
instead of asking, "May I come in?" to which a respondent could 
easily reply "No/' say, "1 would like to come in and talk with you 
about this." Avoid questions such as "Are you busy now?" or 
. "Could I take this interview now?" or "Should I come back?" 
Questions which permit undesired responses can lead or even push 
f ' a respondent into refusing to be interviewed. 
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Descriptive Statistics for Summarizing Data 



The kind and amount of data collected depend on the study objectives. Your data may therefore 
include, in addition to your dependent variables, some or all of the following predictors or indepen 
dent variables: demographic (sex designation, ethnicity, and age); socioeconomic status (parents' 
income pr parents' educational backgrouhd);,type of vocational program in which enrolled; present 
occupation and salary; and other variables of interest. Needless to say, these data need to be system- 
atically summarized by use pf descriptive statistics for ease in presentation and comprehension. This 
section presents some statistics designed to help you in this area. 



Frequency 1 . 

Frequency refers to the number of times a specific item occurs^ For example, you may want to 
kn,ow the frequency distribution ot your respondents (former vocational students) in terms of some 
predictor variables like sex designations, ethnicity, .and vocational programs in which they are enrolled. 
Besides the usual frequency table distribution, these data can be graphically presented in a'v^riety of .* 
ways that will facilitate comprehension, such as the use oia histogram, polygon^or pie graph. In addi- 
tion, frequency data can be presented as Cistributions of simple frequencies, percentage'frequencies, 
or cumulative frequencies. Youn type of data> the central theme of your study, and the kind of audience 
receiving the report are the major factors that need to be considered in determining the bes.t way to 
present your data. Figure 9 includes some different.uses of graphic presentations to illustrate percentage 
distribution. 



Measures of Central Tendency ; c 

Measures of central or average tendency include the following: arithmetic mean, median, and 
mode. Average is commonly defined as a number indicating thq central value of ? group of observa- 
tions. The average serves two important functions: 

First, it is a shorthand description af a mass di quantitative data obtained from 
a sample. , . . An average is, therefore, descriptive of a sample obtained at a 
particular time in a particular way. Second, it also describes indirectly ., but with 
some accuracy the population from which the sample was drawn CGuilford and 
Fruchter 1973, p. 42). - v * . * - 



Let us take/$a[ary satisfaction score as aa example. The mean is the arithmetic average of the 
scores of the respondents. The mean is computed by adding all the scores of the different respondents 
and dividing it by the total number of respondents; thus, the mean can be heavily influenced by 
extremes, particularly in a small number of cases. The median is the midpoint between the highest 
and the lowest score, above or below, which are half the respondents. The mode is the score with the 
highest number of respondents. The example that follows illustrsjtes^the three different itiethods of 
measuring central tendency. • * ^ 



SOURCE: Franchakand Ponce et al., pages 103-107. 
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• Figure 1 

Graphic Presentations of Percentage Distributions 
(Degree of Satisfaction with Salary of Former Vocational Students) 




DATA COMPILED FROM A STUDY OF 
FORMER STUDENTS' J0B SATISFACTION 





Salary satisfaction 




Frequency 




^score M 


Code 


(f) 




5 


Hyjhly satisfied 


10 


$ 


4 ' 


Satisfied * 


20 






Neithei satisfied 






\ 


nor dissatisfied 


35 




•2 


Dissatisfied 


18 




1 


Highly dissatisfied 


12 




s 


Jotal number of scores = 


95 



Sum of all scores 
Mode - The most frequently occurring score = 3 

Median ^ The score that is midpoint between the highest and lowest score" - 3 

Sum of all scores divided by the total number 6f scores - 283/95=2.98 



Mean 



Product 
(f)M 

50 
80 

105 
36 
12 

-283 



Where the distribution is reasonably symmetrical, the arithmetic meari^ usually preferredand 
is most useful because it is generally the most reliable or accurate. It has stability and consistency; 
thus, it is better suited for arithmetical computations, as will be seen later in the chapter. On the ' 
other hand, as suggested by Fitz-Gibbon and Morris (1978, p. 26), the median is used rather than • 
the meanjf (1) yoll will not need to perform statistical tests requiring the mean, (2) if you need a 
quiatestimate of group performance, or (3) if the distribution is not symmetrical. Additionally, if 
the lev^l of measurement of your variables is nominal, only the mode is meaningful. 



Measures of Variabilfty ^ 

^Measures of variabflity are also known as measures of dispersion, heterogeneity, scatter, or 
spread. They aroused to describe important characteristics of distributions (i.e., the variability of 
, the scores. Using the salary satisfaction scores as an example, measures of variability answer the ' 
question: how varied are the scores that contribute to the mean salary satisfaction scpre of the 
group? There are two general measures of variability discussed in this chapter, the total range and 
the standard deviation. 

The total range is easily determined, but it is also a highly unreliable measure because it is 
based only on two value?. Agajn using salary satisfaction score a^an example, the.range is computed 
by subtracting theNlowest repeated score from the highest reported score. Different groups of 
respondents and types of vocational programs can be only crudely compared on the basis of their 
range of salary satisfaction scores. * ■ • 

The stafndard deviation is "the most commonly used indicator of degree of dispersion and is 
the most dependable estimate of the variability in th? total population f rom-which the sample 
came" (Guilford and F.ruchter 1973, p. 65). The standard deviation of the salary satisfaction scores 
of former vocational students is a statistic indicating hov\f much the scores are spread out around 
the mean. The smaller the standard deviation, the less spread are the scores. Knowing the standard 
* deviation of a group of measurements performs two functions (Morris and Fitz-Gibbon 1978, p* 30) 

K • It provides a good means for describing the spread of certain measures 

(e.g., income or perception on the quality of training) obtained from * 
the administration of a particular instrument. 1 
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• It prQvides a basis for later statistical procedures that you may want to 
^ *pefform, such as a- test of the significance of differences between group 

means: 

The example below will help you differentiate between the two types of measures: 



Salary satisfaction 




Frequency 


score (x) 






€ 


25 


10 


4 


16 


ft * 

20 


. * 3 " . 


' . 9 


35 


2 


• 4 


18 • 


; . 1 

> * * 


1 • 


12 






n= 95 . 



Sum = 



^ mix) 

. 50 
' 80 
105 
/ 36 
12 

283 



Sum = 



250 
320 
315 
72 
12 

969 



Range - highest score - lowest score 
- 5-1 M 

Standard deviation -^pjfx 2 ) (fx) 2 / n 

= 'lbo1$69) -(283) 2 /95 
= 1.36 ' 
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GRAPHIC PRESENTATIONS * <■ 

Graphic presentations are an extremely useful and efficient medium far the presentation of 
quantitative data in a manner which facilitates the comparison of values, trends, and relationships. 
Graphic displays have qualities and values lacking in*a narrative presentation. ^ 

1. They are more effective in creating interest and catchiqg the sttgntton of the reader. 

* 2. Jhey provide visual relationships whiob are m&re clearly grasped and more ea§Uy 
remembered. 

H. They are more time efficient, since the essential meaning of large masses of statistical 
data can be assimilated at a glance, 

4. T^oy^Drovide a more comprehensive picture of the problem, making for a more •« 
, complete and better balanced understanding. ^ r 

5. They stimulate and facilitate analytical thinking and investigation which bring out 
hidden facts and relationships. t • 

Graphic presentations include the following forms: 

I . Rectilinear coordinate charts - The most frequently used of this type is the\imp1e, 
arithmetic line chart. A number of useful variations exist; the cumulative curve chart, 

✓ staircase curve chart, simple-surfaceror silhouette chart, staircase surface chart, 
multiple-surface or band chart, and the 100 percent surface chart. 

2. Bar and column charts - The major use of these forms is to facilitate the visual *° 
comparison of the magnitude of coordinate items or parts*of a total. The bars in a 
bar chart are arranged vertically irfa column chart. Basically, there are at least eight 
types of bar chartsTflTe "simple bar chart, the bar-and-Symbol chart, the subdivided-ba 
'chart, the subdivided 1,00 percent bar chart, the grouped-bar char*t,°the paired-bar 
chart, the deviation-bar chart, and thesliding-bar chart. 

There are also eight basic types of column charts: simple column charts) connected- 
column charts, groups-column charts, -subdivided-polumn charts, rfej-deviation . * 
.polumn charts, grdss-defoation column charts, floating-column charts, and range 
s charts. % x r 

3. Semilogarithmic or ratio charts — This type of chart is especially suitable fpr showing 
proportional arid percentage relationships. It is a good method'for portraying rates of 
change in^a graphic way. Th^typrr of ^hart not only correctly represents relative w 



SOURCE: Stephen J. Franchak and Michapl H. Kean. Evahiatjdh Handbook. Guidelines and Practices for the 
Utilization of Evaluation ReMlts (Columbus. The National Center for Research in Vocational Education, The Ohio 
State University, 1981), pp. '50-58. 1 . * 
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changes, but also indicates absolute amounts at the same tirfte. The vertical axis is ruled 
logarithmically, and the horizontal axis, arithmetical^: The cor^tinued narrowing of 
*the'spacings of the scale divisions on the vertical axis is characteristic of logarithm^ 
ruling. On^the other hand, the equal intervals on the horizontal axis areJndicative of 
arithmetic ruling. This chart is also sometimes referred to as a ratio chart because of the 
proportional r^Jtionships which itportrays. * 

• • - r r?W( 

* " 4. Frequency graphs and related charts*— There are three basic types of simple frequency*!^ 

* ^ • grapfts: frequency polygon, histogram, and smoothed frequency ctfrve. The cumulative- 

- frequency grdph, or ogive, is w^N suited to tbe followmg.purpoter: (a) to determine and 
showthe number br proportfdn of cases above or below a givep tfalue, and (b) to com- 
pare two or more frequency distributions?^ " 

< . s ^ • ' . v 

Probability graphs are based on the normal frequency curve. This Vjethod provides a test 
for proportional asymmetry as well as demonstrates comparisons Oltween empirical and 
theoretical distributions and prediction. ^ . " v ' 

r " • . 

5. Miscellaneous graphic forms - The pie chart* may be used t<3 show cpmponent relations. 
The various segments of a cirgle represent component parts of the total. The trilinear ^ 
chart simultaneously portrays three variabjes in the form of elements of a single function 
of activity. It ]$ always a 100 percent chart, since the sum of the three value°s indicated 

* is equal tq 100 percent. Trjlinear charts are especially useful in portraying operating, 

* prpdGfction, or other costs expressed by a threefold breakdown. * 

The scatter diagram (scattergram) end othertyp'esof correlation charts show in graphic 
f&rm the degree and type of relationship or covariation between two series of data: (n 
statistical terms, tjjie relationship*betvtfeen two or more variables is described as correla- 
tion. The fan chart portrays change for two different periods either by percentages or 

* $ ' i^dex numbers. As many as ten ox fifteen items may be shown, depending on the range* 

ajjd scatter 6f values. * 

Ranking or rating charts place emphasi^ on the positipn of certain items or categories. 
This position is usually based on ma^nitud^e br frequency. Therefore, emphasis is placed" 

on rank-order position, rather than on ttie values themselves. 

< * 

Th$ most effective way of showing spatial relationships is the map. M|aps are often help- 
ful in locating pfbblems, testing hypotheses,^analyzing data, and cjiscpv^ring hidden facts 

- and'relatiorishiRs.The following basic types of maps may be useful in portraying statis- 
tical data: (a) cross-hatched or shaded maps, (b) spot orpaint-symbol maps, (c) isoline 

maps, (d) maps with one or more'types of graphs superimposed, and (e) a combination' 

Of two'or more of'the preceding types. - ■ / ♦ , 

« - * * " *— ^ 

Pictorial, graphs and charts may bfe used with popular reports whichate prepared for 
nontechnical use. They add interest for the reader who npay not be otflengjise motivated 
0 to look at the item. Charts drawn in projection have limited use in vocational informa- 
tion packagmg, largely because of the complexity involved in designjpgKthree-dimensional 
pictorial gra"phic forms which are distortion-free. 

. This is a very brief outline of some graphic forms which vocational education evaluators may 
consider for reporting evaluation results. The reader is referred to figures 1 through 7 for selected 
ideas for developing graphic displays/ . 
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(Three'-Dimensional Bar Chart) 
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Vocational Program Code: 

1 Plastics Technician 

2 Horticulture Production 

3 Livestock Management 

4 Fashion Retailing 

5 Insurance 

, * 6 Marketing 

7 Accounting 



8 Quantity Food Preparation 

9 Auto Mechanics- - 

10 Practical Nursing 

11 Data Processing (keypunch) 

12 Cosmetology 

13 Interior Design 
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Figure 2 
(Line Graph) 

10f H-12TH GRADE ENROLLMENTS BY PROGRAM. 19-/19- 
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Figure 3 

(Bar or Column Chart) 
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Figure 4 
(Bar Chart) 
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(Column Chart) 
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Figure 6 
(Bar Chart-Shading) 
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* t (Three-Dimensional Bar DSsign) 
STUDENT ENROLLMENT BY PROGRAM BY COURSE ,/ 



It 



b rafting 




Auto Mechanics 



iiimni.rii.i 



15% 



business and 
Office 











7% 


|7%J 

















Regular students 



AA degree program 70% 

Diploma program 15% 

Recertification 5% 

Adult hobby and 
special interest 1% 

Licensing 4% 

Job advancement 5% 



Handicapped 



Oisadvantriqed 



/ eric ., 



1.51 „ 



0! » * 



13 



« 



A more detailed description about each specific type of chart with numerous examples may be 
found by consulting the following references: 

v AT&T. Making the Most of Charts: An ABC of Graphic Presentation, Washington, DC: 
Navy Publications and Printing Service, November 1970. 

Schmid, C.F., and Schmid, S.E. Handbook of Graphic Presentation. New York: John 
s Wiley and Sons, Inc., 1974. 

Starr, H.; Maurice, C; Black, M.; and Keller, P. Selecting, Analyzing, .and Displaying 
n Planning Information. Columbus: The National Center for Research jn Vocational 

Education, The Ohio State University, 1979. 
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functions 



Staff Functions and Competencies 

©- * 

The following functions and competencies were identified for staff to provide follow-through 



♦ 



/ 



• Individual and group counseling 

• Employer contacts * m 

• Agency referral contacts 

• Subcontracting for services 

• Designing and developing materials 

• Evaluating services / 

• Monitoring counselor case loads 



■i • - ^ 
Competencies * * 

r * 

Individual and group counseling. The counseling function was divided into four subgroups' 
general, employability, job adjustment, and career and educational planning. The first subgroup 
represents a comrrion core of competencies that are relevant to alf areas of fojiow-through counseling 
regardless of Jhe service area in which theyare used. The last three relate respectively to sh^ific - 
follow-through services described in the model: job search assistance, job adjustment cdunseling and 
career planning and traininb assistance. ( 

General: t 

•• Interview clients," by telephone or in person, to obtain information on theif current education 
and employment status. ' ' t • 

t • Determine clients' needs for follow-through services based upon the assessment of their 
education and employment status. " « ' 

• Maintairrappropriate records documenting counseling activities performed. * \ 

• Develop rapport with clients: exhibit etmpathy apd patience, be sincere, Use tact, build trust 
and learn the language or jargon t>f the^client popu ration. " ' 

• Recognize the influence of clients' other life roles and priorities (e.g., family responsibilities) 
on employability. . 

• Educate clients' significant others concerning the value of .follow-through series for the 
, clients in order to gain the support of those others. , 

• Observe clients' physical and,emotional status (e.g., use of drugs and alcohol, ability to get ■ 
^ • .along with othepsfttf identify problems; that may affect their job success. ; ' y - 

• Encourage clientsjo^Teveiop positive attitudes toward themselves, others, and work. , 

• Provide opportunities for clients to develop personal motivation and a sense of responsibility. 

' • Instruct clients on problems-solving techniques and encourage them tause techniques for 
solving various k^ds of problems. , * * . 



SOURCE: Campbell et al., pp. 58-65. 

* 4 
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Employ ability: 

• Instruct clients in methods of locating job, openings. 

• Teach clients how to interview for jobs and to prepare job application materials. 

• Inform clients of conditions of employment (e.g., the employer's and employee's rights and 
expectations, criteria for advancement). 

• Explain the woman's expanding role in the,United States labor force to those clients whose 
culture defines the woman's employment role in a traditional or limited way. 

•^Arrange for clients to observe successfully employed role models (e.g., through on-the-job 
visits, classroom visits by persons* outside the program or former program participants, 
media presentations). 

• Encourage clients to seek employment despite apparent lack of progress. 

• Describe acceptable and Unacceptable behavior for the, world of work (e.g., attitudes, . 
appearance, attendance, promptness, adherence to organization's rules). 

Job adjustment: * 

•.AssisFclT££t§ in examining their employment situations to identify job-related factors (e.g., 
insufficient job knowledge, poor work habits, negative,attitudes) that impede their optimal 
job performance. 

• Assist clients in assessing problems outside the job (e.g., inadequate child care or transpor- 
tation) that impede their optimal job performance. 

. /* 

• Use-group counseling techmques, such as lecture, group discussions and conferences, training 
groups, role playing, simulations, gammg, in-basket techniques, and use of audiovisuals, to 
help clients identify and solve job adjustment problems. 

• Counsel clients on a one-to-one basis to help them identify and solve their job adjustment 
problems? v 

Career and educational planning: , % 

• Provide clients with career information to assist them in exploring and choosing careers. 

• Maintain a file of support service agencies, including contact information, referral procedures 
and services provided. 

• Contact agencies to inform them of clients' service needs. ' 

• InfoFm clients of agencies that can provide-required support services. 

Subcontracting for services; 

• Identify services nfeeded from outside sources. « * ^ 

• Identify available service providers. 

• Determine available funds to be expended on outside services. 

• Develop formal requests for services. * 

• Initiate contracts with service providers according to .established policies and procedures. 



■ x ■■ ■ I - . 

Designing and developing follow-through materials: 

• Determine thp kinds of mateVials needed ta support follow-through services. 

• Acquireand evaluat^'the appropriateness of existing materials for follow-through services. 

• Revise or adapt existing materials for use in follow-through services. 

• Develop follow-through materials, such as instructional packages, filmstrips, slide/tapes, and 
group exercises. 

• Arrange for the development of follow-through materials. 

Evaluatingservices: « , 

• Review goal (s) and objectives of follow-through services. 

• Determine which elements of follow-through services are to be evaluated. 

• Idjj^ify measures of success of follow-through services. 

• Identify sources o'f feedback information for evaluating follow-through services. 

• Develop methods of collecting mforofation forfoNow-through evaluation. 

• Determine methods by which evaluation information can be analyzed. ^ 

• Determine means of transmitting feedback information (for follow-through evaluation) to 
staff (e.g., forms, reports, staff meetings). % ' * 

• Determine a time schedule for collecting, analyzing, transmitting, and reacting to evaluation 
information. T ^ \ * m 

• Provide Information about future trends and technological changes tlrat may affect 
employment. * \ 

• Help clients to develop career decision-making, goal-setting, and goal-achieving skills. 

• Encourage and support clients vyho are interested in*career§ that are nontraditional for 

their sex.. . ,„ " « » ' 

■ *v ■ 

• Assist clients in^ssessing and redirecting career goals* ' » 

• Identify outside sources for career planning assistance to which clients can be referred. 

•. Inform clientBof education ancjf training organizations and institutions that^may meet their 
draining needs. 




Employer contac, 

• Identify existing employment opportunities for clients. 

• Obtain job information from employers, sucjras job requirements, evaluation procedures, 
criteria for advancement, company faolicie^regtifations, and benefits. ' 

• Review with employers the traits (skills, work habits,..and personal characteristics) they 
are seeking in potential employ&es.^ 1 , 

• Confer with employers about clients' performance, progress?, job adjustment problems, and 
ways the clients can resolve their problems. * •/ *~ 

• Discuss with employers the reasons for client job terminations. ^ 

• Mediate between employers and clients to'help resolve conflicts when job-threatening 
situations arise. " 
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Agency referral contacts: 

• Identify agencies in th£ community that^provide support services. 

• Obtain literature describing community support services (e.g., a support services referral 



handbook). 



y 



• Review with agency staff specific information about available services (e.g., type of service 
provided, eligibility, methods of referral, fees, schedules). 

Monitoring counselor case loads: 

• Determine an appropriate counselor-client ratio. " 

• Devise procedures for assigning clients to counselors and>or counselors to substitute for 



each other in the event of absence. 



\ 



• Establish a schedule of services, including follow-up checkpoints and fnaxmium period of 
service delivery. 

* > 

• Devise a plan for maintaining contact with clients through which to conduct ongoing needs 
assessment. 

• Instruct clerical staff on scheduling client appointments. 

• Devise staffing plans and schedules for<conducting group activities. 

• Develop procedures for terminating clients' participation in the program. 

• Establish procedures for counselors to report their progress and problems in maintaining 
their client case loads. * \ 



» > 
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Staff Composition and Size 

Thrdt types of staff are needed in a follow-through program: a services-Coordinator, counselors, 
and orte /r more clerical workers. The duties of each are described as follows. 

\ ' 

) 

Coordinator of follow-through services 

This person is responsible for the administration of follow through services. Duties include the 
following: 

• Supervising staff 

• Assigning and monitoring the counselor case load 

• Designing, implementing^and equating services 

• Coordinating functions withmllfe foj low-through services program 

• Coordinating follow-through services with other related programs and agencies 

• Administering the budget ' 



Follow-through counselors v , 

. . • <* 

. These staff members are directly responsible Tor providing follow-through services to clients to 
enhance their job success and«career progression. Services may include the following: 

• Needs assessment . * « * 

. • Placement assistance " 3 . ' , * | 

• Individual and group counseling 

• training in job search skills • 
* • Career planning assistance * ^ 

\ • Identification of training opportunities : 

• Referral to appropriate agencies c for assistance with personal problems" * 

Counselors also provide assignee to the coordinator in the administration and evaluation of 
services. . j 

Clerical workers V ' I 

Clericahstaff are responsible for providing clerical and administrative support for follow-through 
services.. Duties include such routine'office wor^ as thfe following: 

• Typing • . , 

• Filing- ^ 

• Processing forms 

• Arranging -appointments ' 

• Answering telephones ♦ , . w . 

• * * * 

j- Clerical services may also be#provided for clients participating in jo£> search activities. 

The size of the counseling staff wiM vary with the size of the service case load. There is no 
precedent for client-cognselor ratios for follow-through services; however, on the basis of past 
experience with simUar programs (Gonzales 1980), it is recommended that the ratio npt exceed " 
60:1 *ki dense urban areas, a somewhat smalle^case lo^d may be advisable. The size of the clerical 
staff will depend upon the number of other staff in the program, client case load, whether clerical 
services are provided to clients conducting job seacqh activities, and other factors. . - 

159 ) . , 



, Gordon and Erfurt (n.d.), on the basis of . work with disadvantaged clients in the Jobs/Now 
Program, advocate a racial/ethnib mixture among the staff. A*mong other things, this enables thie 
stafilCLobserve client interaction with people of different backgrounds and to identify any poten- 
tial job adjustment problems related to racial/ethnic factors. For similar reasons, representation of 
both sexes in the counseling staff might be advisable. 
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WORK MATURITY SKILLS . ^ 

# # 

* 

1.0 Present a positive image 

1 .01 'Follori good grooming practices ~ 
, ,„ A. Maintain cleanliness 

B. # Practice dental hygiene ■ ^ * 

1 .02 Practice good health habits 

A. * Follow good nutrition and diet principles 

B. Follow habits that promote physical fitness 

1 .03 Dress appropriately for the job fc , ) 

A. Select appropriate work clothing 

B. Keep clothing in good condition, 

1 . 04 Exhibit self -con fidence 

A. , Identify personal strengths } 

• • 

B. Use positive body language * N 

2.0 Exhibit positive work attitudes > ^ 
r m 2.01 Use basic social skills 4 t 
. A. Assume positive behavior 

B. Exhibit interest in others 
2.02 Be creative and willing to Team >■ 

A. identify creative potential in self and" others 

B. Seek new ideas and ways of doing things 
> 2.03 Take pride in your work j \ 

A. .Develop a sense of contribution about your work 

B. B^BPrticular about the finished product % 

3.0, Practice good work habits*""****- \^ * 

3.6f Maintain regular attendance - ( 

A. * Be punctual^ 

B. Be'dependable 

3.02 Be thorough and diligeot ^ 

' * A. Complete tasks willingly and onjfime 

B. Be persistent and persevering 

C. Maintain professional knowledge ^ 



SOURCE: Developedby the Technical Assistance 'for Occupational Skills Training Project, sponsored by the Office 
of Youth Programs, U.S. Department of Labor, 1981. 

i v 
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3.03 Follow safety practices 

A. Identify and follow general safety rules 

B. - O perate equipment safely 

C. Identify and demonstrate first aid techniques- 

4.0 Practice ethical behavior 

, » « \ 

4.01 Exercise integrity and good judgment 

A. Maintain confidentiality 

B. Maintain loyalty Jfe 

C. Demonstrate honesty 

4.02 Respect property 

A. Care for the building 

B. Care for equipment and furniture 

4.03 Follow company rules a - \ 

A. Follow company poljcies and operating procedures 

B. Cooperate yith organization and union to resolve conflicts 

5.0 Communicate effectively 
' 5.01 Demonstrate spoken communication skills 
A. > Use proper language - 
Br Use proper speaking techniques 

C. Correctly relate information and messages 
5 02 Demonstrate written communication skills 

A. State information in a clear, concise, alnd complete manner 

B. Conveynaccurqte apd complete information 

5.03 Demonstrate nonverbal communication skills 

A. Use body language to improve speaking skills 

B. Use body language to improve listening skills 

5.04 Demonstrate good listening habits 

A. ' Exhibit quajities of 3 good listener 

B. Follow verbal instructions 

6.0 Accept res pons ibtlity 
« 6.01 Use Initiative 

A. • Anticipate responsibilities on the job 

* B. Be willing to perform your scope of work 
6. 02 Use ££oblFm-solving techniques • 
f\. Analyze the problem 

B. Identify and choose among alternatives 
^ C. * Devise a plan of action 
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6 . 03 Manage persona/ responsibilities 

A. Manage responsibilities of family living 

B, Manage personal finances 

7.0 Cooperate w^th others 

7.01 Work as a member of a team 

A. j|)mmunicate freely with coworkers and supervisors 

B. Deal with job frustrations * 

7.02 Work under supervision 

A. Identify/and work within the organizational structure 

B. ,Cope with conflict 



/ 

/ 
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» - W Group Counseling • « 

Lecture * . ' f " "4^ 

' - ' » ' ' ** 

arourv^n?" Wh kn0VV J ed9eab,§ ab ° Ut 3 ^ n t0 P ic P resents information on that topic to a 
lie th ■ * Th ' S teChmqUq is 9eneraMy considered * n inf erior training method }o°several 
reason*, the clients ..n a passive role, placing the burden solely on the traioe ^itureVtPnTto L N 

rauo, ana an excellent lecture can be an inspirational model to the clients. 

The lecture technique may be most appropriate for providing employment orientation infor 
mation Crufes, procedures, tax information, labor laws, benefits, personal finance empCer exnec 
TT^it:T\ iS ^ rec6mmended * the sole meihod of provid n^'grX counS 
iZSS v ♦ ^ h6n USpd 35 3n introduction to another technique or for providing a final svn 

thesizmg statement of what has been taught through anptheV technique. - ; ' V 

Conference or Group Discussion 

■ coals A a nd°n U h P i 1 l e ^t r an f d i Sma " 9r ° UP °^ MentS WOrk t oae ther in a discussion setting. ThtTpurpose 
goals, and objectives of the session are carefully explained by the leader, whb keeps the discXoT 
focused on the objectives. Problems and issues are advanced, either the leader presents tvS 
problems or clients present their actual problems, and group members participate ^solution 
In the course of discussion^li^ts use each others' insights to shage their own thin&nc T - 

that "nrnM 0 n U H n ahd ^^J' { ^ 2) ' ln their discu ^° n * work entry problems of youth conclude^ 
S , JSS P d ^ cuss, °^ and conferences might provide one of the better intervention strategies to 
be used for aiding work-entrants in their development of flexible coping'styles" (p. 37J. 

Advantages of .the conference technique are that it enables clients, to discover solutions to their/ 
own problems and that it usually facilitates retention of learning; it is cost effective i is f lex bl e f 0/ 
many u S e S and can be combined easily with other techniques (such as case studies, ole Playing and 
use of audioyisuals); and it can alert the counselor to individual clients' potential on-the job problems 

s keo s ma rtl erVen r°" S P T 1 le " b6nefitS ° f thiS teChni ^ Ue are maximized when the group 
is kept small, the goals are made clear, the group process is W elJ organized, ancUefective leadership 

prevents one or two clients from monopolizing the discussion. This technique^ be^speciX effec-' 

tive for developing problerrvsolving sk i IJs^bangi ng attitudes, values, and responses to sup v Ln and 

improv.ntf.nteract.on skills with cowW^t is hot an effective- method of impart ng lot of sub 

stantive content within a reasonable time. , • ./ 9 

• . ■ . 

t 

Training Groups ("T Groups") or Sensitivity Training 

1 

A small groupof clients and a facilitator focus on some dimension of interpersonal relations 
critically evaluating themselves and the others while focusing on the "here and now." The goal is to 
see oneself as seen by others, using conflict as a vehicle for accomplishing this - 
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SOURCE: All materials in this appendix are from Campbell et al.. pp. 40-53. 



On the applicability of this technique to the general working population (as opposed to those 
in managerial training), Hacqpun and Campbell (1972) state that: 
« 

(1) work settings arasocial ones; (2) work involves the face-to-face interactions 
— of many people; (3) work conflicts are frequent occurrences. It would seem 
% that these situations are well suited to the use of the T group as an intervention 
strategy (p. 33). ' * * 

The T group can be an effective technique for increasing sensitivity; improving the capacity for open 
communication, and increasing flexibility m role behavior, l.t should be .noted, however, that the 
effects of sensitivity training seem to fade quickly and the transferability of what is learned through 
this technique to the work environment has not been determinedf r 

Role Playing , " ^ 

• Participants in a small group assume the roles of characters in a problem situation and act out 
the situation. Problems may be provided by the leader, presented through case studies or open-ended 
audiovisual vignettes, or suggested b^ the clients. If the group is large it can be broken into smaller* 
groups, who act oljt the same situation simultaneously, and then reassemble to discuss the solutions/ 

Role playing is an effective technique for improving communication and coping §kills,, increasing 
self-awareness and self-esteem, learning appropriate job language and behavior, reducing prejudice, 
and changing work values and attitudes. It is also a means for the counselor to predict job behaviors 
in clients. One drawback of rote playing is that some participants either find it hard to take the situ- 
ations seriously or focus too much on acting and lose sight of the counselihg goals. Advantages of 
this technique are that it is motivating and interesting to the client, an active form of learning jn 
which the learner receives immediate feedback and reinforcement, a good vehicle for clients to 
practice.coping behaviors, and fairly easy to design, Role playing <js somewhat costly in terms of 
administration and,time. . , . 



Gaming Techniques 



* Two or more clients, each given information about a hypothetical problem or situation, com- 
pete within'the framework of a^game. Each strives to win the game and maximize returns. 

Games are most frequently used to improve goal-setting and decision-making skills and to 
develop greater awarerless of business environments. Gaming can be an effective technique for some 
clients because the element of fun is motivational. Further, clients are allowed to set the(r own goals 
and are help ecTto understand which actions ought to be taken to attain those goal! Immediate feed- 
back is reinforcing and forces realism regarding the causality of one's actions leading to ou^cpmes. * 

Many suitable games are available'commercially— for example,, 77?e Job Game (Employment 
Training Corporation) and Life Career Game (Western Publishing Company). When existing games 
are used for thfe techj&ique, the cost fends to be quite low in relation to the outcomes. * 



Simulation > 

{ Clients assume worker roles in ajiypotjietical situation, frequently some type of business ven- 
ture. Participants learn the importapce of worker interrelationships through carrying out interrelated 
tasks. ~ ; 
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For some clients, this can be a motivational technique because of the participatory element 
and the interesting situations that can be created. Simulations are usually flexible, in that different" 
numbers of roles can be used together oj roles can be combined in different ways. It is important 
to use this technique selectively, with those clients wTio are most likely to benefit from it. 

When commercially availabfe simulations are used— for example; Adventure- Lifelong Learning 
Si/nutation J/^bt Publishing Company) anjj Project See^ (The National Center for Research in Voca * 
tional tducation)^preparation for this technique is fairl^inexpensivg, although staff involvement in 
relation to payqff may be high. " « 

Ip-basket Technique , « 

This technique is closely related to simulation but cgn be conducted with Jess elabQrate struc- 
ture and^pfe^ardtion* Each client receives a description of a^woVker role and an in-basket of job tasks 
representing day-to-day problems or decision pointsr. (Although this technkjueis most effective when 
several client$ar£ given interrelated roles and in-baskets^ it may also be used y$th individuals.) Clients 
deal with the items In their in-baskets, then disguss th^ir activities with' the CQunselqr, wno helps them 
interpret appropriateness of decisions and actions and their impact on other workers' cafefc. 

This, technique is an appropriatexounsjeling tool for adjustment probfans related to decision 
making and personnel interrelationships. x 

■ V ■ . 

Case Studies* « v 

Written protofem descriptions are presented to the clients, who try to resolve the problems. 
Members of the group share their icjeas and discuss alternative solution^. 

This technique may be appropria-tefor working^pn situational problems, personal work habits, 
and problems related to interpersonal relations and response to supervision. It is also use/ul as a 
follow-up to other techniques to dejtermine how much clients have retained. , ° 



^udiovisuals - 

Films, filmstrips, slides, tape recordings, videotapes, and closed circuit television can be used 
in a variety of ways in job adjustment counseling. v > m 

Many films, filmstnps, and recordings that are available commercially deal.withr work adjustment 
- topics. Examples ipcludethe foll|wing.y / 1 * y v y 

• ABC's of Getting. and Keeping a jfoMEye Gat6 House) 

• Exploring the World of Wo/k (Specialized Serviqeand Supply Co.) 
£ Getting a Job and On the Job (Education Design) 

*~ • Opportunity (Scholastic Book Services) 

• Rolesjapd Goals (Argus Communication) 

• Your First Week on the Job, You and Your Job Interview, Trouble at Work,' . 
^Job th§t Goes SQmeriace, and Job Hunting: Where to B$gin (Guidance Associates) 



c 



Si 



Materials such as these are versatile, they can be used in different settings and with any size oigfoup; 
'if J<ept in stock, they can be used with little notice or preparation and can be chosen to fulfill a 
variety of purposes; and they require a minimum of staff time. The content should be studied care- 
fully for accuracy, appropriateness.for the counseling goals, and absence of ambiguity and bias. 

Disadvantages of this type of medium are that the learner is in a passive role and^hat the 
materials may not be strictly relevant to each client's counseling needs. To help focus tfte content 
on specific problems and to involve the clients ^ctively in interpretation cTf the content, audiovisual 
presentations should be followed by discussion., , _ • 

f> / " * . ' . 

Audio arid videotapes and closed circuit television are useful for another purpose, microteaching. 
In this technique, the clients give a short presentation or participate in role playing. The segment is 
recorded and replayed and the clients watch or listen to the recording with their counselor and other , 
members of the group. The clients receive immediate feedback through watching their own behavior 
and from the discussion that follows. . \ 

Although performing before camera or microphone can be threatening and depersonalizing to 
* some clients, these feelings can be minimized by preparing the clients for thg experience of self- 
observation. While the initial cost of audiovisual materials and equipment is high, the cost ovec time 
is low because they can be reused/ * , 
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Individual Assistance 

Individual assistance, in Jthe form of counseling or other services, has the advantage that it can 
be tailored exactlyto the clitnt' sneed sj Thte cQntent can be individualized on the basis of the'client 
needs assessment and service! orirTbe rendered when they are most needed. Several techniques for 
providing individual assistance are ctescrjbed as«follows„ *' \ 



Individual Counseling 



Counseling js provided on a one-to-one basis to help the client deal with adjustment problems 
on the job and to develop coping skills that will help t{ffc client handle future on-the-job problems 
without assistance. * v ^ ^ 

It is important that counseling be provided early,*at the first sign pf a potential adjustment 
problem. In many cases this makes it possible to avert a, problem rather than to remedy it.'fft may 
be too| late to solvfca problerfi through, counseling after a potentia^problem has escalated into an 
on-the-job clash.) Individual counselin^may be considered an expensive technique in terms of 
counselor-client ratio, but it is frequently more efficient than group counseling in terms of getting 
to the problem quickly and resolving it. • * 



/ 



, Dialogue with Employer ' * , 1 ' ' 

Ongoing*clialogue with clients' employers is a good source of information about job adjustment. 
By keepfhg informed in this way, the counselor can be alert to potential problems and offer coun- 
seling services before problems become critical. * * *x 



Interventions Advocacy 



i 



Sometimes a job adjustment problem results .in a crisis-the client is fired, /is under threat of ' 
being fired, quits, oris about to quit— before the counselor learns about the situation. Under these 
circumstances, the counselor may decide to intervene/ ) 



The counselor talks to the employer and the client and determines the nature of the problem * 

*and any underlying causes. A decision is then made as to the best course of action. For example; the 

counselor might— ' • ■ # * 

, , , 

* • talk to.the empJoyer pn behalf ofthe client; 

• get the client to stay on the job; 1 J * 

• counsel the client on coping with job stress; > • 

• get the employer to modify a, stressful situation; 

• refer the client for needed outside ser\|jces. 

• ✓ 
This technique is most easily implemented if an ongoing dialogue" has been maintained with 
the employer. Additional discussion of this technique is presented by Gordon and Erfurt (n.d.), 
p. 119ff.. ' * 
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Programmed or Computer-Aided 

Instruction (PI or CA!) > 

In this technique, small increments of material are presented to the learner and a question is 
asked. If the learners response is correct, new'material is presented; if wrong, the material is repeated. 
In the linear method q| PI, material is presented in ascending order of difficulty, arifJ the material at 
each lev^l must beMearned befdre the next level of material is presented. In the branching method, 
the learner who ghjes a wrong answer is "branched" to a deeper exploration of the problem material, 
i * 

Programmed or computer-aided instruction is available in several forms, including program 
books, piecemeal program, materials, program learning machines that accommodate one client at a 
time^and computer progrips that can accommodate many clients at once, ' 

CA'I and PI techniques are useful only when there is a definite content with "right answers" to 
be learned. This may limit its applicability for some areas of job adjustment counseling. Haccoun^ . 
and Campbell (1972) note that: « • • 

% PI seems more efficient when specific learning criteria or goals are set. Unfor-' 

tunately, setting up specific criteria for problems such as "adjustment to peers ' , 

and supervision" is a difficu It task because theiriteria are often situation- 
d§termined. However, when (and if) these criteria are specified, the positive 
experience with<PI might beindicative of its futyre usefulness as an interven- 
tion strategy (p. 30). * * . 

S^ice this technique focuses on individual diff£rences,7ts effectiveness varies with those differences. 
■ Motivation may be greatest with people who prefer to learn information systematically. Although ^ 
initial cost is v^ry high, PI and CAl systems areJnexpensjve to use. «o 



Modeling . 

The client observes a person (model) performing a task, then' duplicates the task. The task is 
repeated until the client can successfully perform it, and correct performance by the client is 
rewarded. . * y " » 

* Also called "observation learning," "imitation identification, "social learning," and "vicarious 
Jea^ning," this technique may be appropriate for such counseling topics as personal wbrk habits, 
proper use of language and* deportment on the job,, and responses to supervision. It is less appro- 
priate fpr situational adjustment problems because "correctly'\modeled behaviors are difficult to 
transfer from one situation to another. The effectiveness of modeling is enhanced if the model is 
someone who is perceived as being competent and with whorrv^he client can associate. 

..' ' v ••«.,'* " 

Exploratory Experience ■ » ■ 

Often used for people whose^career goals are unclear* this technique may also be useful for the 
client who has a history of work adjustment problems, who.has been identified during trancing as 
# having strong potential for such problems, or who v has no experience whatsSever with work environ- 
ments. In this technique, the clients are placed with a worker on a job in the typfe of industry or 
businessftn which they are seeking employment. The clients observe a typical workday and "get a 
feel for" the work environment 
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Selective Placement 

Employment situations to which clients are referrechnay need to be chosen carefully to avoid 
a particular adjustment problem for which*a potential has been noted in the client. Occasionally an 
instructor or counselor, by observing a client's performance or interaction>with program staff and 
other clifents, will detect an aspect of employment to which the client is likMy to hava,trouble adjust- 
ing- (for example, personal grooming or strict regimentation). If it is determined that the client's 
attitudes or behaviors cannot be modified sufficiently, or that employment is needed before modifi- * 
cation can take place; it may be halpful to place the client on a job in w^hich the problem is not likely 
to'arise. < ✓ 



Referral ^ 

, When personal, family, or other nonjob related problems impede the client's adjustment to wor£ 
it,may be appropriate to refer the client to outside services (for example, child care, legal, or mentaf 
health services) for assistance vi/ith the' problem. This technique is described under "Referral to • 
Support Services." . 



Reading Lists and Printed Materials r . , 

" The counselor provides reading materials, or lists of such materials, from which the client learns 
appropriate behavior patterns* Examples include: / _ 1 ; — ^ 

• Everything a Wdrhari Needsto Know to Get Paid What^he's'Worth ] Bantam Books) * 

• Handbook for Yoimg Workers (U.S. Governmen;'Printing Office) 

• How to Get and Hold the Right Job (U.S. Government Printing Qffice) ^ • / ' - 

• How to Keep Your Job: Poster Series (Walch Pub.) ; . 

• Succeeding in the World of Work (McKnight and McKnight) ,\ f * • 

• Succeeding on the Job: Self-Study Guide fpr Students (Card Set) (^Interstate Printers 

and Publishers) v. 

• A Working Woman's Guide, to Her Job Rights (U.S. Department of Labor) o 

< For written materials to be effective, the reading level and style must b&appropriate for the 
client, the content must be interesting, and the materials must be available. Thus, materials that are 
hard to read, that are presented in a style to which the client does not/elate, or that cannqt be * • * 
obtained without spending money or going across town to get them are not likely to be effective 
tools for job adjustment counseling. Written materialsare best used for reinfofcing'l^arning acquired 
by other methods or providing information to clients who cannot participate in other trainin ^^ 

% . Career Pl&nping and Training Assistance 

Career planning and training assistance are services that help clients identify and pursue their 
career goals. The'fce services are provided to clients who;after termination of employment and training 
programs, (1) have not chosen a career, (2) -have careers and wish to maintain them, (3) have careers 
and wish to advance in those careers, or (4) have careers and wish to change to other careers. 

There are two aspects of career planning and training assistance: career pfenning assistance, and 
referral to education and training programs. 
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Career Planhip^Assistance 

Clients who c<rfpp\e\e CETA training programs often obtain employment in entry-fevel jobs 
that do not offer long-range career opportunities without further planning and, possibly/ training. 
The aim of career planning^assistance is to help clients improve present career paths or choose new 
ones that fit their skills, interests, and occupational aspirations. Career planning assistance cap be 
developed through three approaches: "in-housfc" groups, individual career planning assistance, and - 
referral to agencies. All three approaches to career planning assistance are aimed aj helping clients m 
(O assess their skills, interests, and occupational aspirations; (2) explore career options (including 
nohtraditional career qpfiohs);^) choose new careers or<maintaii>their present ones; and (4) imple : 
metfit their deci'sion^^ * ^0 % » 

"In-house" group career planning assistance. Groups of clients are counseled in career planning 
by program staff. Although targeted at individual needs, the counseling is delivered through struc- 
k tured grpup activities. The counseling includes sonrte or all of the following activities: 

• Assessing clients' skills, interests, occupational aspirations, and personality traits by using 
aptitude and achievement tests, interests inventories, personality evaluations, and other 

instruments. , * 

* * * 

• Acquainting clients with career options through discussions, lectures, and career guidance 
materials. Career information<should'Fnclude the following: 

• Nature Qfrwork ^ 

• Working conditions ^ * » * 

• Hours of work 

- • Salary or wage range 

Opportunities for advancement p * 

• Required skills and attributes (manual dexterity, good vision^ 

• Education and training requirements (type, contenj^Jength) 

• Other prerequisites (experience, license, certification, unicfn or professional v 



gcoup membership) 
^Equipment OfSjjjl 

' Degree of supervisory responsibility ' > 

^ Kind of supervision received ' * : * .< 

• Instructing clients on the decision-making process to facilitate their choosing career paths 
that match their careecJnterests. This activity could also include instruction on prdblem- 

- solvmg.techniques. * % . T ^ 

• Aiding dientsln implementing their career decisions. ThisWivity is usually accomplished 
by referring clients to appropriate training programs that. will prepare them for their 
career choites. * . 

Individual career planning assistance. Clients are counseled orf a one-to-one basis to help them 
resolve career-related questions or problems. The activities used to help individuals plan their career 
may be»the same ones used in group counseling. Clients matf also be directed to career information 
materials so that thf>y can guide themselves in selecting career paths. Examples of such materials 
follow: . ^ 

• Dictionary of Occupational Titles (U.S. Department of Labor) 

• Guide for Occupational Exploration (U.S. Employment Service). 

• Guide to Local Occupational Information (U.S. Employment Service) 



• Job Guide for Young Workers' {U.S. Employment Service) • 

• New Career Options: A Woman's Guide (Human Sciences Press) ' 

• Occupational Outlook Handbook. (U.S. Department of Labor) ' 

Referral to community services for career planning assistance. Clients who need additional / 
assistance may be referred to community services that provide.career planning assistance.' Although 
this will vary by communities, such^services are typically found in- 

four-year colleges and universities; m 1 

' • community and junior colleges; , ' » 

• private groups and agenciesf 

• governmept agencies; 

t * • public adult schools; . • * 

• company personnel offices. <\< 

Career planning^ssistance also can be located through such sources as The National Center for 
Educational Brokering (405 Oak Street, Syracuse, New York 13203), which publishes a national, 
directory of career planning services. Directories of career planning services rfiay also be available 
from local sources or state departments of guidance. 

Referral to Education and Training Programs j I ' 

The purpose of referral is to fink clients with opportunities for'furtber education ortraining 
(for example, postsecondary programs) that can help them. achieve their career goals. The process of 
referral includes four activities: (1) helping clients identify education, and tracing needs, (2) identify- 
ing education and training programs, (3) linking clients with programs that meet their education and 
training needs, and (4) helping clients implement their education and training plans. v 

Helping clients identify educatton and training needs. After clients have decided upon career, 
goals, they are assisted in identifying short-term and long-term education and training needs to 
^pursue those goals. For example, it might be determined that a client needs adult basic Wucatton 
(to upgrade basic academic skills) and then some type of postsecondary vocational training in thfe 
chosen field. - * i 

f • 
Identifying education and training programs. Organizations and institutions arfe identified that 
offer the type of education or training sought by the client. Such organizations and institutions might 
include the following: * 1 b 

•^Proprietary schools ** v 

• Area vocational-technical schools ' 
>• Technical institutes 

• Business and trade schools 

• Business or government sponsored training programs „ ' 

• Community colleges , m . * , 

• Universities ; 

• Adult education programs through public schools * 1 . 

• Correspondence course^ * 

• Apprenticeships * 6 r ; 

• Miliary training 



In addition to local sources of information, directories and guides such as the following may 
be used to identify programs in the areaof the client's edujsatior^and training needs.^ * 

u ^American Trade Schools Directory (Croner Publicafions,«1974) - • "~ « 

• Barron's GuidetoTwo-Y^r Colleges (College Divisjon,Barron's Educational Series, 1979) 

• Community, Junior, and Technical Col 1^9 Director} ('American Association of Community 
and Junior Colleges, 1979) ; • < A 

• Comparative Guide to Two-Year Colleges and Career Programs (Harper aKd Row, 1976) 

• Directory of Postsecondary Schools with Occupational Programs (National Center jor 
Educational Statistics, 1978) « ' "* 

• Lovepoy's Career and : Vooational School Guide (Simon and Schuster, 1978) > 

Uferatsre such 'as catalogue?, pamphlets,>and brochures is-otjtamed to provide the client with 
such information as the foJtowing abou^t theprograms: , - % °* t| 

• Enlrande requirements (entrance examination, education prerequisites/minirrlum grade point 
average, previous training, ^nd^Dri) 

• Training^ tuition fees ~ + * ' 1 ' • ' 

• financial aid possibilities. (loans, w&rk-study.grrangefinents, grants, ancrschplarships) 

• Course requirements for a particular degree, certificate, or license* \ , / 

• Calendar of program offerings ' ... J v 

• Schedule of classes . * * * 

• Deadlines. for submitting applications, ' ■ ' * 1 * ' 

Linking cliehts with education and training pro§rj|*fc.' The cbjjpselor helps the cjient gai'n 
enough information about the prergram and'institutiqmo be able tWnake a decision about pursuing 
the training or education. * * *• • ' 

The directories, guides, pamphlets, and other written materials are stocked in order to provide 
clients with general and specific information atfbut the programs. A browsing library might be estab- 
lished to facilitate clients' access to the written materials. \. 

j Representatives of training programs*might be invited to'speak to groups of interested clients 

about their program*' content, admission requirements, costs^gnd other factors. 

» 

Clients are encouraged to visit the organizations or institutions that house the training programs 
of interest to them, to view the facilities, and cliscuss the nature of the programs with admissions 
staff, instructors, and students. 

> » ' 1* ' 

Where different types of training are available'fn the chosen field (for example, apprenticeship, 
vocational school, and community college), the client is assisted in reviewing and comparing the * 
different prqgrams-their prerequisites, content, training time, type of instruction, training outcomes, 
cost, and so on-to determine the type of training that^best meets career goals and Individual ne^ds. \ 

Helping Clients Implement 

-Education and Training Plans • 

Communication is established with the admissions staff of the training programs to inform them 
of individual clients' career goals and training ne 4 eds. During these contacts, information can be obtained 
about the application procedures, student selection process, deadlines for submitting applications, and 
other mattery related to entry. This information is then used to help the clients decide whether they 
are eligible and in a position to take advantage of a particular program. 
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Clients are assisted with procedures and problems related tp matJfewtfon and participation in- 
the,r des.red programs. For example, the following kinds of assistance m^ht^^ I as ^eded: 



Completing applications 
Scheduling and preparing for entrance tests 
Obtaining financial assistance 



V 



•^Planning fpr training-related expenses (books, materials, tuition, dues) 
• Making child-care and transportation arrangements 

* ^* 

^Referral to'lSupport Services ^ 

that inTpI ra ' t0 t s h up P° rt . se k rvice ^ is provided t0 dient * who need help in relieving personal problems 

' h Id rZ r! T th ? ,r . J ° b Tu 0655 ^ are n0t dir6Ct,y r * ated to their i°bs-Wxample, inadequate 
ch Id care or transportation. The actual help or service that the clients require is delivered by sources 
outside the fallow-through program. It is the counselor's function to help clients identify their prob- 
* lems and to direct them to the services. . 

. Helping Clients Identify Personal Problems 

Clients are guided in examining their respective employment situations and discerning those 
factors in their personal fives that imp^e their dptimum job performance. Clients are encouraged to 
express what they sef as impediments to their job success but are discouraged from relying on program 
staff to make judgments about their personal situatipns or to solve personal problems for them 

Directing Clients to Sources of Assistance - " 

Once the problems have be?n identified, the clients are made aware of service deliverers that can 
provide help in abating the problems. If a support services referral handbook is available it is used to 
provide clients with basic information (name of agency, address, phone nu'mber, scope ot service) 
about those* service deliverers. 

The following are examples tff personal problem categories that might interfere With clients' * 
job success and the service deliverers that might be expected to provide assistance in solving the 
problems: * * ,M 

• Child care * • private day care centers 

# - • jchurch-spcrnsored education centers 
A • county family services 

• Counseling * community mental health centers 

•^private counseling Services 

• public and private hospitals 

• church-sponsored social services 

t • Financial assistance * . 

• budget counseling . community action programs . * 

• consumer credit counseling services* V 

• small business administration 

• utility companies 
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A • rent supplement 
• 'housing financial assistance 



Health 



Legal ks^jstance 



• local hou^jng authority 

• local homestead department 

• hospitals 

• public health services 

• community outpatient clinics 

• local bar association 

• local Legal Aid or legal'rights service 

• legal clinics 

• city prosecutor's office 

• local court ot common pleas , 

• municipal court 
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